Commit Graph

5540 Commits

Author SHA1 Message Date
bigsheeper
cdf8223558 Update segment cgo api
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-08 15:56:03 +08:00
cai.zhang
815a6ca1cf Add aggregation for query result
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-09-08 14:16:03 +08:00
bigsheeper
41d638abb5 Add message client and refactor segment go, construct raw data for segment insertion
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-08 10:39:09 +08:00
rain
c9c7c78340 Fix bug that max time cant be marshaled
Signed-off-by: rain <boyan.wang@zilliz.com>
2020-09-08 10:01:30 +08:00
xige-16
81e70ee6c9 Hash message to partitioned topic
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-07 21:07:36 +08:00
zhenshan.cao
a90b725ba8 Add timestamp for key2segment message
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-09-07 19:46:14 +08:00
rain
642554e7bd Refactor directory structure and update the default value of server
Signed-off-by: rain <boyan.wang@zilliz.com>
2020-09-07 19:19:50 +08:00
bigsheeper
b948a3438e Add api about insertion, deletion and search
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-07 17:01:46 +08:00
zhenshan.cao
cae0f36bdd Add config of pulsar
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-09-07 16:56:57 +08:00
zhenshan.cao
8992611898 refactor proto logic
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-09-06 21:13:06 +08:00
xige-16
d58f6ff817 Support write node send key2seg msg
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-06 19:39:35 +08:00
xige-16
c076bd4a73 Fix the error that write node cannot receive the message
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-06 15:56:10 +08:00
shengjh
bfd4fe5a82 Update the logic of insert and delete
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-05 19:17:08 +08:00
neza2017
559c160dd7 Set sync type
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-09-05 17:47:28 +08:00
neza2017
a32cd72ba9 Add time sync
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-09-05 10:04:22 +08:00
shengjh
112da1337e Change timestamp type to uint64
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-05 09:58:12 +08:00
xige-16
6eff45989e Serialize produce message in proxy node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-04 18:37:21 +08:00
xige-16
e13fc08d09 Refactor write node using message client
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-04 17:52:49 +08:00
shengjh
e69c19db5f Add pulsar message
Signed-off-by: shengjh <1572099106@qq.com>
2020-09-04 15:17:11 +08:00
bigsheeper
5e89722d88 Update proto
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-04 14:33:11 +08:00
xige-16
a2de464c71 Add proto for system internal message
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-04 14:31:23 +08:00
cai.zhang
ce95fd4f20 Add interface for generated_ids
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-09-04 11:25:20 +08:00
bigsheeper
947b223bae Add segment status and management
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-03 19:58:33 +08:00
cai.zhang
18d7745261 Update storage interface
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-09-03 10:02:48 +08:00
become-nice
18cf816e56 Update the organization form of the stored prefix key
Signed-off-by: become-nice <995581097@qq.com>
2020-09-03 10:00:48 +08:00
neza2017
18a56c9b5d Add build.sh for core
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-09-02 20:05:02 +08:00
bigsheeper
d461529172 Remove core.go, add ubuntu building dependency
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-02 19:59:41 +08:00
bigsheeper
a4988e8e83 Fix reader unites
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-02 19:02:57 +08:00
bigsheeper
b817fa5aed Add insertion api, fix unittest and data type
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-02 17:18:49 +08:00
bigsheeper
36c8362b41 Add deletion and unitest
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-02 16:23:50 +08:00
bigsheeper
39addf0a55 Update cgo interfaces and add query node id
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-02 10:38:08 +08:00
become-nice
8e323494a5 Add the interface about kv store of writenode
Signed-off-by: become-nice <995581097@qq.com>
2020-09-02 10:36:39 +08:00
xige-16
29d6a3ad0a Add pulsar cpp client
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-09-01 20:50:12 +08:00
become-nice
558a81dcbe Update the interface of writenode
Signed-off-by: become-nice <995581097@qq.com>
2020-09-01 18:11:43 +08:00
bigsheeper
bb9c906ef6 Use go mod instead of GO_PATH and add more cgo interfeces
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-09-01 16:23:39 +08:00
bigsheeper
5a57b62f0c Refactor collection and partition, wrap cgo interfaces
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-08-31 15:54:44 +08:00
bigsheeper
b6cc1df97e Refactor collection and partition
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-08-29 17:42:41 +08:00
cai.zhang
26805ebd3a Add interface for minio and add grpc proto for master
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-08-29 17:40:29 +08:00
bigsheeper
7d8ddf05a9 Add cgo building script and init ago insertion interface
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-08-29 17:37:53 +08:00
FluorineDog
35e45d5766 Support Segment timestamps
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-08-29 14:57:45 +08:00
bigsheeper
04c27b7ccf Sort messages by timestamp
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-08-28 18:39:00 +08:00
shengjh
59aee1e067 Add tikv storage,proxy pulsar thirdparty
Signed-off-by: shengjh <1572099106@qq.com>
2020-08-28 18:19:24 +08:00
bigsheeper
d69c925ba5 Implement the interfaces about insertion, deletion and search
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-08-28 17:29:26 +08:00
xige-16
3b10f74ce1 Use pulsar go client in query node and write node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-08-27 16:45:43 +08:00
become-nice
f1d6b62e1d Add mock unittest
Signed-off-by: become-nice <995581097@qq.com>
2020-08-27 11:06:17 +08:00
FluorineDog
08ee90e1de Add gtest dependencies
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-08-27 10:08:42 +08:00
become-nice
22a44c995d Add serialzation function
Signed-off-by: become-nice <995581097@qq.com>
2020-08-26 18:29:42 +08:00
FluorineDog
fc6e31c8b0 Add test for unique_ptr manual release
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-08-26 17:38:45 +08:00
FluorineDog
3c4a9f38b0 Fix compatibility of Gtest
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-08-26 17:30:32 +08:00
FluorineDog
996c591088 Enable Segment Naive and Base, support Collection
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-08-26 16:49:03 +08:00