sighingnow

sighingnow

Member Since 8 years ago

@alibaba , Beijing, China

Experience Points
233
follower
Lessons Completed
925
follow
Lessons Completed
586
stars
Best Reply Awards
246
repos

1701 contributions in the last year

Pinned
⚡ Mirror of the Glasgow Haskell Compiler. Please submit issues and patches to GHC's Gitlab instance (https://gitlab.haskell.org/ghc/ghc). First time contributors are encouraged to get started with the newcomers info (https://gitlab.haskell.org/ghc/ghc/wikis/contributing).
⚡ The etcd-cpp-apiv3 is a C++ API for etcd's v3 client API, i.e., ETCDCTL_API=3.
⚡ vineyard (v6d): an in-memory immutable data manager. (Project under CNCF)
⚡ A universal Python parser combinator library inspired by Parsec library of Haskell.
⚡ (Unofficial) Release libclang (clang.cindex) on pypi.
⚡ Build Jekyll site with GitBook style!
Activity
May
20
22 hours ago
Activity icon
issue

sighingnow issue comment sighingnow/jekyll-gitbook

sighingnow
sighingnow

support for cover images [Feature Request]

gitbook allows for cover images.. would be great to see support for that here, thanks!

example: Screenshot from 2022-05-20 01-21-27

sighingnow
sighingnow

Looks good! Could you please paste a link for the website here?

Thanks!

push

sighingnow push v6d-io/v6d

sighingnow
sighingnow

Build vineyard-migrate on MacOS with proper ABI tag (#754)

Signed-off-by: Tao He [email protected]

commit sha: 15ebd9834b2fdbe30b9f3a1f25ead4294fbc630b

push time in 15 hours ago
pull request

sighingnow pull request v6d-io/v6d

sighingnow
sighingnow

Build vineyard-migrate on MacOS with proper ABI tag

What do these changes do?

as titled.

Related issue number

Related to #729

pull request

sighingnow pull request v6d-io/v6d

sighingnow
sighingnow

Build vineyard-migrate on MacOS with proper ABI tag

What do these changes do?

as titled.

Related issue number

Related to #729

push

sighingnow push sighingnow/v6d

sighingnow
sighingnow

Fixes issues in compatibility build (#751)

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Build vineyard-migrate on MacOS with proper ABI tag

Signed-off-by: Tao He [email protected]

commit sha: f92722eaf79eb72a2bd5477fad087cd95b503f09

push time in 15 hours ago
Activity icon
issue

sighingnow issue v6d-io/v6d

sighingnow
sighingnow

HDF5 driver to interact with HDF5 format with data structures supported by vineyard

Describe your problem

TBF

Additional context

Add any other context about the problem here.

Activity icon
issue

sighingnow issue v6d-io/v6d

sighingnow
sighingnow

Vineyard should be a sidecar container when deployed along with workload containers

Describe your problem

TBF

Additional context

Add any other context about the problem here.

May
19
1 day ago
push

sighingnow push v6d-io/v6d

sighingnow
sighingnow

Fixes issues in compatibility build (#751)

Signed-off-by: Tao He [email protected]

commit sha: 932108fbc400f76d0be089f699b132682b044a1a

push time in 1 day ago
pull request

sighingnow pull request v6d-io/v6d

sighingnow
sighingnow

Fixes issues in compatibility build

What do these changes do?

as titled.

Related issue number

N/A

pull request

sighingnow pull request v6d-io/v6d

sighingnow
sighingnow

Fixes issues in compatibility build

What do these changes do?

as titled.

Related issue number

N/A

push

sighingnow push sighingnow/v6d

sighingnow
sighingnow

Fixes issues in compatibility build

Signed-off-by: Tao He [email protected]

commit sha: 56720bbd18803f9bd434d30f7fa59f5285ef6f7c

push time in 1 day ago
push

sighingnow push sighingnow/v6d

sighingnow
sighingnow

Support life cycle management for external blobs (#687)

  • Add lifecycle tracker, dependency tracker, usage tracker

Signed-off-by: septicmk [email protected]

sighingnow
sighingnow

[1/2] Support "shallow copy" between sessions (normal only) (#688)

  • Rename External|external|EXTERNAL to Plasma|plasma|PLASMA.
  • Support shallow-copy between sessions
  • Fixes Codacy issues.
  • Avoid client-side failure in MoveBuffersOwnership.

Signed-off-by: septicmk [email protected]

sighingnow
sighingnow

[2/2] Support "shallow copy" between sessions (plasma and normal) (#689)

  • Support shallow copy between heterogeneous sessions
  • Add tests for shallow copy.
  • Require a higher version of jinja2

Signed-off-by: septicmk [email protected]

sighingnow
sighingnow

Bump jackson-databind from 2.12.4 to 2.12.6.1 in /java (#690)

Bumps jackson-databind from 2.12.4 to 2.12.6.1.


updated-dependencies:

  • dependency-name: com.fasterxml.jackson.core:jackson-databind dependency-type: direct:production ...

Signed-off-by: dependabot[bot] [email protected]

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

sighingnow
sighingnow

Bump logback-core from 1.2.5 to 1.2.9 in /java (#691)

Bumps logback-core from 1.2.5 to 1.2.9.


updated-dependencies:

  • dependency-name: ch.qos.logback:logback-core dependency-type: direct:production ...

Signed-off-by: dependabot[bot] [email protected]

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

sighingnow
sighingnow

Fixes the CI failure of dask. (#692)

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Split table_shuffler_beta impl to cc file (#694)

Signed-off-by: zhanglei1949 [email protected]

sighingnow
sighingnow

Restrict the version of click. (#695)

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Resolves the bug in arrow fragment string test. (#696)

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Code generate for C++, and implements ArrowFragment using annotations. (#698)

  • Code generate for C++, and implements ArrowFragment using annotations.

Signed-off-by: Tao He [email protected] Signed-off-by: Tao He [email protected]

  • Optimize the find program process in vineyardd.

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Try (sliently) remount when needed and when possible. (#700)

  • Try (sliently) remount when needed and when possible.
  • Refine the LD_LIBRARY_PATH settings.

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Refine the invokation of java generator inside CMake process. (#702)

including retrieve the jar using mvn, etc.

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Remove write msg mutex for SocketConnection. (#704)

  • Remove write msg mutex
  • Remove socket_msg_queue.

Signed-off-by: septicmk [email protected]

sighingnow
sighingnow

Sync with the bug-fixed version of etcd-cpp-apiv3. (#705)

  • Sync with the bug-fixed version of etcd-cpp-apiv3.
  • Move the implementation of Close() to the .cc file.

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Use a callback to ensure the RPC/IPC server ready before return the the client (#706)

  • Use a mutex to ensure that the "Start()" won't executed if "Stop()" been called first.

The session might be stoped once after initialized. Addresses the CI failure catched in https://github.com/v6d-io/v6d/runs/5879153388?check_suite_focus=true.

  • Push the return of "CreateNewSession" to the "Ready" callback.

  • Fixes the result returing.

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Use send() rather than write() to avoid the SIGPIPE signal. (#707)

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Support query object id from a client-side pointer. (#709)

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Correctly find vineyard package on Debian with multiarch support (#710)

  • Correctly find vineyard package on Debian with multiarch support
  • Inline the cmake variable.

Signed-off-by: lidongze0629 [email protected]

sighingnow
sighingnow

Fix incorrect value of partition size in GlobalDataFrame (#711)

  • fix incorrect value of partition size of global dataframe
  • Fix tensor

Signed-off-by: siyuan0322 [email protected]

sighingnow
sighingnow

Adapt the parsing in code generator to latest libclang. (#713)

Signed-off-by: Tao He [email protected]

commit sha: b9d325e054eeb771f2d319ef99810d9983a83047

push time in 1 day ago
push

sighingnow push v6d-io/v6d

sighingnow
sighingnow

Bump up vineyard version to v0.4.2

commit sha: c5ff9b36c9ad03c78717e220626eac88449ec315

push time in 1 day ago
Activity icon
created tag

sighingnow in v6d-io/v6d create tag v0.4.2

createdAt 1 day ago
push

sighingnow push v6d-io/v6d

sighingnow
sighingnow

Instructions for deploying airflow on Kubernetes with vineyard as backend (#736)

Signed-off-by: Tao He [email protected]

commit sha: 5fafe72ce9600629c574b6c7b0d1a736612edfbb

push time in 1 day ago
pull request

sighingnow pull request v6d-io/v6d

sighingnow
sighingnow

Instructions for deploying airflow on Kubernetes with vineyard as backend

What do these changes do?

  • Add a reference values.yaml for helm deployment
  • Add instructions about how to deploy airlfow on kubernetes with vineyard as the XCom backend.

Related issue number

Fixes #720

Activity icon
delete

sighingnow in sighingnow/v6d delete branch ht/airflow-vineyard-k8s

deleted time in 1 day ago
push

sighingnow push sighingnow/v6d

sighingnow
sighingnow

Instructions for deploying airflow on Kubernetes with vineyard as backend

Signed-off-by: Tao He [email protected]

commit sha: 4bc130912e681cfe51ee363a7f1c5588d36aa864

push time in 1 day ago
push

sighingnow push sighingnow/v6d

sighingnow
sighingnow

Update wheels to different paths based on python version (#737)

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Makes the readme satisfy the requirements of pypi (#738)

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Add a dep when compile on macos (#743)

Signed-off-by: waruto210 [email protected]

sighingnow
sighingnow

Delete the incorrectly checked files (#744)

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Add CI actions for ArchLinux and CentOS latest (#745)

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Add a documentation section for how to run test cases (#747)

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Validate the fd set between client and server (#749)

Signed-off-by: Tao He [email protected]

sighingnow
sighingnow

Instructions for deploying airflow on Kubernetes with vineyard as backend

Signed-off-by: Tao He [email protected]

commit sha: b8eb5b7e4609d419e33efc2e6951348ccd62faf1

push time in 1 day ago
Activity icon
delete

sighingnow in sighingnow/v6d delete branch ht/revisit-read-from-streams

deleted time in 1 day ago
push

sighingnow push v6d-io/v6d

sighingnow
sighingnow

Accept both dataframe stream and recordbatch stream when loading graph from streams (#750)

Signed-off-by: Tao He [email protected]

commit sha: 192fe5de06f4cca8e7f61400c757ff91cc4d1d9e

push time in 1 day ago
pull request

sighingnow pull request v6d-io/v6d

sighingnow
sighingnow

Accept both dataframe stream and recordbatch stream when loading graph from streams

What do these changes do?

Add a variant of loading from dataframe stream implementation.

Related issue number

Fixes #728

Activity icon
issue

sighingnow issue v6d-io/v6d

sighingnow
sighingnow

Accept both recordbatch stream and dataframe stream in the fragment loader

Describe your problem

Refactor the stream reader to formulate some untilities to load chunks from streams, both dataframe streams and recordbatch streams, as they serve a very similar propuse.

See also current implementation: https://github.com/v6d-io/v6d/blob/main/modules/graph/loader/arrow_fragment_loader.h#L57

Additional context

Add any other context about the problem here.

pull request

sighingnow pull request v6d-io/v6d

sighingnow
sighingnow

Accept both dataframe stream and recordbatch stream when loading graph from streams

What do these changes do?

Add a variant of loading from dataframe stream implementation.

Related issue number

Fixes #728

Activity icon
created branch

sighingnow in sighingnow/v6d create branch ht/revisit-read-from-streams

createdAt 1 day ago
Activity icon
delete

sighingnow in sighingnow/v6d delete branch ht/fix-readme

deleted time in 1 day ago
push

sighingnow push v6d-io/v6d

sighingnow
sighingnow

Validate the fd set between client and server (#749)

Signed-off-by: Tao He [email protected]

commit sha: 4e4f8dce5eebdcb35f11f14e236289b37f12e269

push time in 1 day ago
pull request

sighingnow pull request v6d-io/v6d

sighingnow
sighingnow

Validate the fd set between client and server

What do these changes do?

This pull request adds a validation pass to verify the consistence of fds between client and server, before issuing the recv_fd calls.

This pull request prevents the client being blocked by recv_fd when there's actually no fd sent from the server.

Related issue number

Fixes #748

Activity icon
issue

sighingnow issue v6d-io/v6d

sighingnow
sighingnow

Verify the pairing of send_msg/recv_msg for transfering fds between client and server

Describe your problem

The send_fd/recv_fd should already be paired between server and clients. However we have noticed cases where the client is blocked by recv_msg (in recv_fd), which shouldn't happen.

We need to add some assertions to check such conditions and dump some information for debugging.

The behaviour that you expect to work:

Additional context

Add any other context about the problem here.

pull request

sighingnow pull request v6d-io/v6d

sighingnow
sighingnow

Validate the fd set between client and server

What do these changes do?

This pull request adds a validation pass to verify the consistence of fds between client and server, before issuing the recv_fd calls.

This pull request prevents the client being blocked by recv_fd when there's actually no fd sent from the server.

Related issue number

Fixes #748

Previous