Commit Graph

3801 Commits

Author SHA1 Message Date
jingkl
e3f905350d
[skip ci] Add notes to impl (#13076)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-09 16:09:32 +08:00
jingkl
8f896b4ecf
[skip ci]Add notes to conf adapter (#13068)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-12-09 15:53:32 +08:00
cai.zhang
29f4a209c0
[skip ci]Add comment for GetIndexFilePathInfo in indexcoord (#13059)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 15:49:51 +08:00
cai.zhang
6f71bf42d4
[skip ci]Add comment for GetIndexStates in indexcoord (#13058)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 15:47:51 +08:00
cai.zhang
7966691696
[skip ci]Add comment for MarkIndexAsDeleted in indexcoord (#13057)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 15:31:18 +08:00
XuanYang-cn
3c2e785234
[skip ci]Update license for qn queryservice (#13011)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 14:39:06 +08:00
XuanYang-cn
12ec33368a
[skip ci]Update license for qn querynode (#13010)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 14:37:22 +08:00
XuanYang-cn
0262942a14
[skip ci]Update license for qn query collection (#13009)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 14:35:32 +08:00
bigsheeper
57707e0d11
Close tSafe update log print (#12992)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 14:33:44 +08:00
bigsheeper
772771bd85
Stop queryCollection before releasing replica (#12982)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 14:31:28 +08:00
Cai Yudong
15b932c63c
Add unittest IVFFlatNM for Indexing (#13044)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-09 14:21:28 +08:00
cai.zhang
342200ce13
Estimate the memory size of the index before building the index (#12973)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 14:19:40 +08:00
godchen
cec42cb19a
Make arrow use jemalloc (#13029)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-09 14:17:36 +08:00
bigsheeper
3e9e7f707b
[skip ci] Add comment for insertNode insert (#13037)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 14:13:53 +08:00
bigsheeper
b206980feb
[skip ci] Add comment for filterSegmentsByPKs (#13036)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 14:12:00 +08:00
bigsheeper
e858006fd8
[skip ci] Add comment for processDeleteMessages (#13035)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 14:10:06 +08:00
godchen
febdda90f4
Change binlog writer close behavior (#13046)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-09 12:37:06 +08:00
congqixia
8f87cc7ef1
Fix JoinIDPath logic problem (#13039)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-09 12:05:04 +08:00
zhenshan.cao
3bb2412ddb
Remove dependency with etcd_meta in segcore (#12987)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-09 11:45:06 +08:00
cai.zhang
961e9379c6
Check the indexcoord state before get index state (#12452)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 11:43:09 +08:00
congqixia
b42019256c
Fix log concat in newServiceTimeNode (#13030)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-09 11:39:06 +08:00
XuanYang-cn
dbf757e08b
Change genKey into JoinIDPath (#12959)
1. Simplify genKey(), make genKey a rpc call
2. Unify the usage of JoinIDPath

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 11:09:06 +08:00
XuanYang-cn
a9a332dbcf
Fix empty segment compact and load (#12710)
1. Fix compaction save empty segment bug
2. Fix load empty segment bug
3. Add UT for dmlchannels to 100%

Resolves: #12450

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 11:03:08 +08:00
jaime
f479381c39
[skip ci] Add a comment for describeCollection function in meta_cache (#13018)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-09 10:51:19 +08:00
jaime
7691876fff
[skip ci] Fix golint error in mem_kv (#13020)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-09 10:49:25 +08:00
xige-16
00720f8dd6
[skip ci]Fix golint for ReleasePartitions (#13022)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-09 09:27:06 +08:00
xige-16
5dd0cb35bc
[skip ci]Fix golint for LoadPartitions (#13021)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-09 09:25:16 +08:00
jaime
efaca29ee4
[skip ci] fix a grammar error of the comment in etcd_kv (#13019)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-09 09:23:08 +08:00
Cai Yudong
1ae249adb5
Update profiler CMakeLists.txt (#13001)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 23:23:06 +08:00
dragondriver
59c93eb351
Refine log of GetPartitionStatistics (#12940)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-08 23:05:07 +08:00
godchen
5c44ee8c0f
Close binlog event when error occur (#12995)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 21:11:39 +08:00
XuanYang-cn
383f14999d
Make Arrow compilation easier (#13005)
replace all the bundled libraries with arrow_bundled_dependencies

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-08 20:55:05 +08:00
godchen
0c60df4b3b
[skip ci]Fix comment typo (#13017)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:51:06 +08:00
godchen
6845b0e986
[skip ci]Fix comment typo (#13016)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:49:14 +08:00
godchen
9363dbf7b2
[skip ci]Fix comment typo (#13015)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-12-08 20:47:24 +08:00
yukun
426f73ce07
[skip ci]Add comment for rocksmq reader (#13014)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-08 20:45:35 +08:00
yukun
490f8b50e1
[skip ci]Add comment for rocksmq reader (#13013)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-08 20:43:24 +08:00
yukun
0f387871c1
[skip ci]Add comment for rocksmq reader (#13012)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-08 20:41:27 +08:00
Bingyi Sun
a78b2010e9
[skip ci]Improve log style (#13008)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-08 20:27:06 +08:00
Bingyi Sun
48c5632277
[skip ci]Improve log style (#13007)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-08 20:25:15 +08:00
Bingyi Sun
320cfbb606
[skip ci]Improve log style (#13006)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-08 20:19:26 +08:00
congqixia
aea5a61e9a
Add switch for auto compaction (#12974)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 19:47:05 +08:00
Cai Yudong
85efcd8582
Move fiu nlohmann and easylogging to core/thirdparty (#12981)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 18:45:07 +08:00
edward.zeng
260d3e124d
[skip ci] Refine datacoord channel store comment (#12991)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-08 17:57:05 +08:00
edward.zeng
2e84eef229
[skip ci] Refine datacoord channel manager comment (#12989)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-08 17:53:22 +08:00
edward.zeng
8ca248dce6
[skip ci] Refine datacoord allocator comment (#12985)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-08 17:35:06 +08:00
cai.zhang
719dc34ed1
[skip ci]Add comment for UpdateVersion in indexcoord (#12979)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-08 16:49:05 +08:00
cai.zhang
1d4d3e6ad0
[skip ci] Add comment for BuildIndex in indexcoord (#12978)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-08 16:47:17 +08:00
cai.zhang
f5700da683
[skip ci]Add comment for AddIndex in indexcoord (#12977)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-08 16:45:23 +08:00
zhenshan.cao
69259d9294
Call ReleaseUnused of memorypool in arrow (#12893)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-08 15:53:05 +08:00
dragondriver
19ad282810
Add ut for GetComponentStates (#12968)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-08 15:17:31 +08:00
shaoyue
8f2c630434
[skip ci] Add comment for grpcclient.ClientBase (#12966)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-08 15:15:42 +08:00
shaoyue
5045ba208e
[skip ci] Add comment for storage.StatsWriter (#12965)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-08 15:13:32 +08:00
shaoyue
34fadc9ab6
[skip ci] Add comment for EmbedEtcdKV (#12964)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-08 15:11:33 +08:00
jaime
42b161ae95
[skip ci] Add graceful stop grpc server log in datanode (#12923)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-08 15:09:42 +08:00
jaime
8b309eed80
[skip ci] Add graceful stop grpc server log in indexnode (#12826)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-08 15:05:52 +08:00
jaime
a1b907313f
[skip ci] Add graceful stop grpc server log in datacoord (#12825)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-08 15:04:00 +08:00
jaime
263e22fe66
[skip ci] Add graceful stop grpc server log in indexcoord (#12922)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-08 14:59:56 +08:00
dragondriver
8eda489c5b
Refine log of ShowPartitions (#12941)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-08 14:57:48 +08:00
dragondriver
dcb6c3b2fe
Refine log of ReleasePartitions (#12939)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-08 14:55:23 +08:00
dragondriver
349e3aa8f8
Add ut for AlterAlias when proxy is unhealthy (#12911)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-08 14:53:32 +08:00
dragondriver
6bdbe23e9f
Add ut for DropAlias with a short context (#12910)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-08 14:51:18 +08:00
dragondriver
e09058fe20
Add ut for DropAlias when dd queue is full (#12909)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-08 14:47:04 +08:00
zhenshan.cao
3d8a0453b7
Remove unused log (#12793)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-08 14:45:04 +08:00
dragondriver
48923398a5
Refine log of LoadPartitions (#12824)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-08 14:35:02 +08:00
dragondriver
17565db1bf
Refine log of HasPartition (#12823)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-08 14:31:05 +08:00
congqixia
c289a19fb8
Remove log string concat in root_coord.go (#12932)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 14:23:05 +08:00
congqixia
1195f441b2
Update DataNode state before stop (#12946)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 14:19:04 +08:00
bigsheeper
214f40b209
Add timeout ts for search and query (#12890)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-08 14:15:03 +08:00
JackLCL
73b63b9a02
[skip ci]Fix error log output format in segment_replica.go (#12929)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-08 13:55:04 +08:00
bigsheeper
0ba224dbf6
[skip ci] Add comment for insertData (#12821)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-08 13:53:13 +08:00
JackLCL
a6ce7d7f53
[skip ci]Fix error log output format in meta_service.go (#12928)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-08 13:51:09 +08:00
JackLCL
22c002606b
[skip ci]Fix error log output format in meta_table.go (#12931)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-08 13:14:19 +08:00
Cai Yudong
45bac3e4ec
Move profiler under core/thirdparty (#12949)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 13:01:04 +08:00
Cai Yudong
df875c5985
Clean useless thirdparty version (#12944)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 12:15:03 +08:00
Cai Yudong
7b97b155e8
Remove duplicated thirdparty (#12925)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 10:37:37 +08:00
Cai Yudong
2c42abf23b
Optimize segcore CMakeLists.txt (#12924)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 10:35:04 +08:00
congqixia
de454956fe
Refactor session WatchSessions to allow rewatch when Rev Compacted (#12880)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 10:11:04 +08:00
xige-16
03c27b17e2
[skip ci]Fix golint for LoadCollection (#12919)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-08 09:41:05 +08:00
Bingyi Sun
5db438b885
[skip ci]Add comment in datanode service (#12915)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-08 09:39:15 +08:00
cai.zhang
ae92cc1270
[skip ci]Add comment for reloadMeta in indexcoord (#12876)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-08 09:35:32 +08:00
cai.zhang
65182f0227
[skip ci]Add comment for reloadFromKV in indexcoord (#12875)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-08 09:33:41 +08:00
cai.zhang
02dabbe4b5
[skip ci]Add comment for saveIndexMeta in indexcoord (#12874)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-08 09:31:47 +08:00
Bingyi Sun
fbba24891c
[skip ci]Add comment in datanode client (#12914)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-08 09:29:21 +08:00
bigsheeper
c85a21edef
[skip ci] Add comment for insertNode operate (#12908)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-08 09:27:31 +08:00
bigsheeper
2b74d22b72
[skip ci] Add comment for insertNode name (#12907)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-08 09:25:40 +08:00
XuanYang-cn
c05e498440
[skip ci]Update license for qn plan (#12902)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-08 09:23:49 +08:00
XuanYang-cn
83dec8981e
[skip ci]Update license for qn partition (#12901)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-08 09:21:56 +08:00
XuanYang-cn
7311fcb85e
[skip ci]Update license for qn paramtable (#12900)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-08 09:20:08 +08:00
yukun
5c84992d4c
[skip ci]Add comment for rocksmq reader (#12898)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-08 09:18:15 +08:00
yukun
14f5348e1d
[skip ci]Add comment for rocksmq reader (#12897)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-08 09:16:23 +08:00
yukun
43eece5545
[skip ci]Add comment for rocksmq reader (#12895)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-08 09:14:32 +08:00
edward.zeng
4c7c4226f5
[skip ci] Refine msgstream comment (#12873)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-08 09:12:43 +08:00
Bingyi Sun
f2e5b96fb0
[skip ci] Add Deprecated for WatchDmChannels (#12913)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-08 09:07:21 +08:00
jaime
7d02208d71
[skip ci] Add a comment for reloadFromKV in index_checker (#12921)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-07 21:49:04 +08:00
xige-16
6050504d43
[skip ci]Fix golint for querycoord cluster (#12918)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-07 21:47:12 +08:00
xige-16
39557f1e4d
[skip ci]Fix golint for ReleaseCollection (#12920)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-07 21:33:04 +08:00
bigsheeper
4d80ea2b11
[skip ci] Add comment for deleteData (#12906)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-07 21:29:21 +08:00
congqixia
615b23a7b3
Update querycoord state to unhealthy before stopping (#12905)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-07 21:27:29 +08:00
dragondriver
2b22986e53
Refine log of DropPartition (#12822)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-07 21:11:04 +08:00