Commit Graph

1422 Commits

Author SHA1 Message Date
Cai Yudong
8405d90f5e
proxy add illegal check for search result (#7227)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-23 17:03:51 +08:00
godchen
33583525c5
Add connection manager (#6867)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-23 10:00:12 +08:00
godchen
bf2c427609
Fix connection timeout (#7203)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-20 17:52:11 +08:00
congqixia
be5c492e5a
Add datacoord unit tests (#7197)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-20 17:50:12 +08:00
congqixia
881d0af1fc
Add sync logic in TestWatchChannel (#7188)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-20 17:48:13 +08:00
XuanYang-cn
9e71daa759
Fix rocksdb not installed problem (#7200) 2021-08-20 17:46:48 +08:00
groot
1c6f5104f7
Improper error returned by calc_distance (#7175)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-08-20 16:19:42 +08:00
sunby
6e34f4c7f1
Add a seal policy which restrict the lifetime of a segment (#7172)
issue: #7164
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-20 15:42:12 +08:00
紫晴
7233b62dad
Enable 70% of delta condition judgment for codecov (#7160)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-08-19 15:50:12 +08:00
congqixia
ec9ccd8bd1
Fix DropCollection not processed by datanode (#7151)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-19 15:06:12 +08:00
cai.zhang
171088409b
Increase the timeout for grpc connection when create index (#7163)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-08-19 14:32:11 +08:00
xige-16
76066b5659
Fix IVF_FLAT index's wrong meta_data (#7167)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-19 14:26:11 +08:00
sunby
3cc210da26
Add flush interval (#6996)
Time tick message is sent about per 0.2 seconds. DataCoord will call
`FlushSegment` too frequently. We add a min interval for segment flush. A
segment will called `FlushSegment` only once between the interval.

issue: #6995
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-19 14:08:10 +08:00
sunby
4f7c3e7d3a
Save binlog path in SegmentInfo (#6590)
issue: #6589
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-19 13:00:12 +08:00
dragondriver
648d22ee40
Expose metrics of IndexCoord and IndexNodes (#7157)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-19 10:28:10 +08:00
godchen
8cc24e09c9
Make users get vectors without using local storage (#7134)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-18 16:30:11 +08:00
紫晴
09525f5723
Update file of codecov (#7144)
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-08-18 14:48:11 +08:00
Cai Yudong
305fa9c17e
Fix timestamp go back issue for timeticksync (#7123)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-18 14:36:10 +08:00
groot
b4eb20f2c0
Fix calc_distance TANIMOTO bug (#7140)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-08-18 11:16:10 +08:00
dragondriver
e45cb6c644
Expose system topology information by proxy (#7137)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-18 10:12:10 +08:00
Cai Yudong
21117241ec
Let system panic if kv operation fail (#7143)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-17 23:06:10 +08:00
cai.zhang
3d83e99a99
Adding indexnode should be processed asynchronously (#7141)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-08-17 20:26:11 +08:00
cai.zhang
c2a4bd3e9c
Lock when writing meta instead of trying to connect to indexnode (#7136)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-08-17 17:54:10 +08:00
紫晴
1b4231b4e8
Add yaml file of codecov (#7124)
* Add yaml file of codecov

Signed-off-by: wangting0128 <ting.wang@zilliz.com>

* Update code of codecov

Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2021-08-17 11:56:11 +08:00
dragondriver
7eb8a665b2
Expose metrics of QueryCoord and QueryNodes (#7113)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-17 10:06:11 +08:00
congqixia
fb22d122e5
Add EarliestMessageID patch logic (#7119)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-16 19:08:09 +08:00
yukun
61bda45e35
Add ConfAdapter to check search (#6971)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-08-16 18:54:10 +08:00
yukun
847586eb95
Add rocksmq retention (#6617)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-08-16 18:46:10 +08:00
yukun
671b2737d2
Remove RetrieveRequest and RetrieveTask (#6848)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-08-16 17:06:10 +08:00
xige-16
b035ec5c7b
Enable search when querynode only load segment (#7104)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-16 12:24:09 +08:00
sunby
9551dc3b7e
Fix segment auto flush bug (#7085)
issue: #7084
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-16 11:00:09 +08:00
Cai Yudong
e771bda92f
optimize retrieve output vector code structure (#7102)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-14 11:18:10 +08:00
cai.zhang
382fa6f274
IndexNode dose not need to wait for IndexCoord to start to comlete (#7074)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-08-13 18:12:08 +08:00
XuanYang-cn
86ca96a02e
Fix master branch unittest error (#7083)
Resolves: #7080

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-13 14:00:14 +08:00
XuanYang-cn
6c5be83ea1
Refactor NewEtcdKV API (#7075)
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-13 11:04:09 +08:00
congqixia
e1b3273d1c
Add Datanode watch etcd channel (#6965)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-13 10:50:09 +08:00
sunby
5c383d1d02
Add a checker to listen for the timetick. (#7061)
issue: #7060
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-12 19:58:08 +08:00
Xiangyu Wang
5e78fd6a97
[skip ci]Update approvers (#7063)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-12 19:36:09 +08:00
Cai Yudong
6c75301c70
optimize search reduce logic (#7066)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-12 18:00:11 +08:00
dragondriver
b3f10ae5cc
Fix 6990, enhance the log when parsing grpc recv/send parameters (#6993)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-12 16:16:09 +08:00
congqixia
3f21e3d062
Fix querynode tt producer leak (#7059)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-12 14:16:08 +08:00
bigsheeper
b9d3897deb
Return error when any failed detected in loadSegment (#7005)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-08-12 14:14:08 +08:00
Cai Yudong
85ea051ddc
change growing segment default value to -1 (#7054)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-12 12:32:07 +08:00
sunby
31182e52a9
Fix expire allocation bug (#7053)
issue: #7052
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-12 10:48:08 +08:00
godchen
7fc7623b92
Add vector data memroy existence check (#7044)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-11 19:50:09 +08:00
XuanYang-cn
9d81a90402
Fix mem leak of flush cache in DataNode (#6862)
Resolves: #6858

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-11 14:24:09 +08:00
groot
bdb8396e74
Fix CalcDistance wrong result when fetting vectors from collection (#6976)
* Fix CalcDistance wrong result when fetting vectors from collection

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* Fix CalcDistance wrong result when fetting vectors from collection

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* preset capacity

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* error check

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* code lint

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-08-10 11:59:28 +08:00
godchen
7557616fea
Change client timeout (#6982)
* Change client timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix error

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* change timeout time

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix conflicts

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* remove ut

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-08-06 14:09:26 +08:00
congqixia
9eb35996b5
Fix pulsar consumer goroutine leakage (#7004)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-06 09:45:24 +08:00
sunby
454620dfaa
Add unit test in datacoord (#6985)
issue: #6984
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-08-04 16:59:25 +08:00