Commit Graph

995 Commits

Author SHA1 Message Date
bigsheeper
12eb8c3da5
Add prometheus metrics for QueryNode (#15649)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-02 14:49:55 +08:00
bigsheeper
6a48071a5c
Set BaseMsg for LoadSegmentRequest, prevent crashing in log printing (#15725)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-02-26 20:09:54 +08:00
godchen
fcf0887d92
Add and implement chunk manager interface. (#15541)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-02-24 23:53:53 +08:00
zhenshan.cao
142848fcc3
Abandon using protobuf to pass binaryset parameter (#15626)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-02-18 18:39:50 +08:00
congqixia
c7f55c2e34
Make SessionWatch keep watch even no Rewatch func when find ErrCompacted (#15497)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-15 15:07:48 +08:00
yah01
684110bc9a
Avoid to copy during converting C bytes to Go bytes (#15551)
* Avoid to copy during converting C bytes to Go bytes

Signed-off-by: yah01 <yah2er0ne@outlook.com>

* Add BytesConverter to achieve no-copy converting C bytes to Go bytes

Signed-off-by: yah01 <yah2er0ne@outlook.com>
2022-02-15 14:17:48 +08:00
Xiaofan
a18d6b46a4
Fix watch dml channel fail because of no collection meta (#15436)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-02-10 13:19:46 +08:00
Cai Yudong
8255b713ac
Move ProxySubName/QueryNodeSubName/DataNodeSubName to msgChannelConfig (#15501)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-09 14:41:45 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491)
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
2022-02-09 14:27:46 +08:00
xige-16
55cdc5aa35
Get indexInfo and segment size by queryCoord (#14207)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-02-08 21:57:46 +08:00
Cai Yudong
1f337891e1
Rename base_param to service_param, rename global_param to component_param (#15463)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-08 20:57:47 +08:00
Ji Bin
d83f69bb21
Support windows compliation (#15448)
- remove dl dependency while compiling some lib under MSYS
- int types aligement in golang
- core/src/utils adaptation for compile under MSYS

issue: #7706

Signed-off-by: Ji Bin <matrixji@live.com>
2022-02-07 23:43:46 +08:00
congqixia
d830791e4f
Respect SegmentIDs in querynode.GetSegmentInfo (#15455)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-02-07 15:35:44 +08:00
Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
Cai Yudong
4bccc85534
Use MsgChannelConfig in GlobalParams for all components (#15163)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-02 00:35:43 +08:00
zhenshan.cao
5bc6ec7250
Fixbug: QueryNode search exceptions will cause memory leak (#15305)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-01-24 21:19:39 +08:00
xige-16
1cd2363bd8
Delete usless params SkipQueryChannelRecovery (#15289)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-21 21:43:40 +08:00
xige-16
57383c9f76
Delete Useless timetick channel (#15296)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-21 14:31:39 +08:00
xige-16
c132302129
Clean flowGraph if watchChannel failed (#15303)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-20 10:01:38 +08:00
xige-16
bbb672cb00
Remove state service in querynode (#15281)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-18 18:43:37 +08:00
xige-16
dfc6670f0f
Unsubscribe channel after query node down (#15230)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-17 17:37:37 +08:00
Jiquan Long
675e6d352b
QueryNodes send search/query results by rpc (#15223)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-01-17 14:41:35 +08:00
Xiaofan
f617c8887b
Time Tick Failed need log (#15225)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-14 23:55:34 +08:00
bigsheeper
0c98f21d4d
Remove global sealed segments in historical (#15177)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-12 17:01:38 +08:00
bigsheeper
ebed1a68ff
Add log for segcore search (#15159)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-11 18:07:34 +08:00
Cai Yudong
951249c6c1
Use KnowhereConfig for indexnode and querynode (#15112)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-11 09:35:34 +08:00
xige-16
99315ce00e
Optimize recentlyModified's lock (#15120)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-10 23:17:36 +08:00
bigsheeper
018f32847f
[skip e2e] Add comment for createSearchPlan (#15111)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-10 22:36:06 +08:00
bigsheeper
4174daee80
[skip e2e] Add comment for newPartition (#15110)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-10 22:34:09 +08:00
bigsheeper
67e8c09df5
[skip e2e] Add comment for removeSegmentID (#15109)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-10 22:32:14 +08:00
Cai Yudong
b6a48817b0
Add MinioConfig in GlobalParams for all components (#15099)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 17:29:34 +08:00
xige-16
97ea9786e1
[skip e2e]Improve getSegmentByIDPrivate log format (#15028)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-10 10:11:34 +08:00
xige-16
43b09c83d1
[skip e2e]Improve getPartitionByIDPrivate log format (#15027)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-10 10:09:39 +08:00
Cai Yudong
7efb02a4c5
Use PulsarConfig in GlobalParams for all components (#15046)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-09 23:45:33 +08:00
xige-16
708dfddba6
[skip e2e]Improve getSegmentInfosByColID log format (#15026)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-07 17:55:23 +08:00
bigsheeper
8d24428c4e
[skip e2e] Add comment for addSegmentID (#15020)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-07 17:47:48 +08:00
bigsheeper
a7ad3f2a76
[skip e2e] Add comment for getSystemInfoMetrics (#15019)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-07 17:45:56 +08:00
bigsheeper
36b9c498ab
[skip e2e] Add comment for appendIndex (#15018)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-07 17:44:04 +08:00
Cai Yudong
f8f61fb116
Use BaseParams etcd configuration for all components (#15012)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
xige-16
f808390f32
[skip e2e]Improve getCollectionID error log (#14964)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-06 23:43:22 +08:00
xige-16
9dbb37c7ea
[skip e2e]Improve addCollection error log (#14963)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-06 23:41:28 +08:00
bigsheeper
f90d5395a1
[skip e2e] Add comment for appendFieldInfo (#14958)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-06 23:35:47 +08:00
bigsheeper
d38ad2f511
[skip e2e] Add comment for appendIndexParam (#14957)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-06 23:33:55 +08:00
xige-16
f7368e35a4
Add log for LoadSegmentsTask (#14703)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-06 23:26:18 +08:00
bigsheeper
c79cbd341a
[skip e2e] Add comment for deleteLoadIndexInfo (#14956)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-06 23:22:03 +08:00
xige-16
0004238669
[skip e2e]Improve AddQueryChannel log (#14962)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-06 23:17:26 +08:00
xige-16
851794598e
[skip e2e]Improve log format (#14886)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-05 21:17:21 +08:00
xige-16
b3d33a78f5
[skip e2e]Improve log format (#14887)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-05 21:15:20 +08:00
xige-16
d751357be1
[skip e2e]Improve log format (#14885)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-05 21:13:20 +08:00
bigsheeper
64a5db66e9
[skip e2e] Add comment for newLoadIndexInfo (#14883)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-05 21:05:20 +08:00
bigsheeper
fe730024ab
[skip e2e] Add comment for newIndexLoader (#14882)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-05 21:03:26 +08:00
bigsheeper
8b9ce5780d
[skip e2e] Add comment for setIndexInfo (#14881)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-05 20:59:30 +08:00
bigsheeper
12f37ffb57
Improve timeout log when query in QueryNode (#14766)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-05 10:35:31 +08:00
xige-16
abf1f58abe
Add log for watchDeltaChannelTask's nodeID (#14702)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-04 20:45:24 +08:00
godchen
9e51591b3a
Fix pulsar reader not close (#14543)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-01-04 14:45:19 +08:00
bigsheeper
bd7a1cd3d1
[skip e2e] Add comment for getIndexInfo (#14745)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-04 14:06:02 +08:00
bigsheeper
cda172ede2
[skip e2e] Add comment for estimateIndexBinlogSize (#14744)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-04 14:04:03 +08:00
bigsheeper
6bace04dd3
[skip e2e] Add comment for getIndexBinlog (#14743)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-04 14:02:12 +08:00
bigsheeper
2e6fe7d815
[skip e2e] Add comment for printIndexParams (#14694)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-31 19:09:19 +08:00
bigsheeper
c95deb2266
[skip e2e] Add comment for loadIndex (#14693)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-31 19:07:23 +08:00
bigsheeper
6b806fc850
[skip e2e] Add comment for getReadyLoad (#14692)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-31 19:05:24 +08:00
xige-16
148dad23ac
Format watchDmChannel's log (#14633)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-30 20:27:20 +08:00
bigsheeper
8a3a1b556a
Free OS memory in QueryNode and IndexNode (#14305)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-30 20:03:29 +08:00
bigsheeper
983d9b4b73
[skip e2e] Add comment for getIndexParams (#14580)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-30 16:57:33 +08:00
bigsheeper
26a8bac54c
[skip e2e] Add comment for getIndexPaths (#14579)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-30 16:56:04 +08:00
bigsheeper
168f05de3a
[skip e2e] Add comment for getFieldID (#14578)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-30 16:39:04 +08:00
Jiquan Long
ebb9b24b47
Improve name of flowgraph node (#14538)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-30 10:33:46 +08:00
xige-16
8b919f50c1
[skip e2e] Add debug log for watchDmChannelReq (#14551)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-29 21:51:45 +08:00
godchen
eb7dcf9ed3
Fix do unsolved msg goroutine not release (#14536)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-29 21:06:03 +08:00
bigsheeper
20178360ba
[skip e2e] Add comment for getBuildID (#14520)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-29 17:39:04 +08:00
bigsheeper
0415618f81
[skip e2e] Add comment for isHealthy (#14519)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-29 17:37:25 +08:00
bigsheeper
6bd640c130
[skip e2e] Add comment for historical retrieve (#14518)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-29 17:35:27 +08:00
Xiaofan
69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
Xiaofan
1408926cd9
Remove logs without enough info (#14440)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:06:47 +08:00
bigsheeper
33b68a11fd
[skip e2e] Add comment for globalSealedSegmentManager (#14444)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-28 19:44:09 +08:00
bigsheeper
b4a04a36ab
[skip e2e] Add comment for removeGlobalSegmentIDsByPartitionIds (#14443)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-28 19:40:22 +08:00
bigsheeper
56d41eaf36
[skip e2e] Add comment for removeGlobalSealedSegmentInfo (#14442)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-28 19:38:36 +08:00
bigsheeper
025fff0bbb
[skip e2e] Add comment for getGlobalSegmentIDs (#14357)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-28 18:48:42 +08:00
bigsheeper
c0ba4c32af
[skip e2e] Add comment for getGlobalSegmentIDsByPartitionIds (#14358)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-28 13:19:40 +08:00
bigsheeper
b20d3e9d13
[skip e2e] Add comment for hasGlobalSealedSegment (#14359)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-27 22:58:17 +08:00
bigsheeper
d384bb1a83
[skip e2e] Add comment for addGlobalSegmentInfo (#14244)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-25 23:20:24 +08:00
bigsheeper
551c685df3
[skip e2e] Add comment for newGlobalSealedSegmentManager (#14243)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-25 23:18:30 +08:00
bigsheeper
d5321f54c6
[skip e2e] Add comment for globalSealedSegmentManager (#14242)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-25 23:16:40 +08:00
godchen
5edc4903d6
[skip e2e]Sort imports (#14182)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-25 19:22:19 +08:00
zhenshan.cao
684a63b698
Fix bug:wait for search finish when stop querynode (#14228)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-25 13:36:19 +08:00
zhenshan.cao
9a2c91d326
Fix bug: refresh config after session init (#14194)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-24 22:22:17 +08:00
bigsheeper
b22cf68c36
[skip e2e] Add comment for newServiceTimeNode (#14205)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-24 19:35:20 +08:00
bigsheeper
84ac0a8b7f
[skip e2e] Add comment for serviceTimeNode operate (#14204)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-24 19:33:39 +08:00
bigsheeper
e5e5937409
[skip e2e] Add comment for serviceTimeNode (#14203)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-24 19:31:31 +08:00
godchen
381698fc18
[skip e2e]Sort imports (#14181)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 18:10:29 +08:00
godchen
b2d4ca8fac
[skip e2e]Sort imports (#14180)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 18:08:39 +08:00
godchen
99798e1318
[skip e2e]Sort imports (#14179)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 18:06:30 +08:00
godchen
08102b8945
[skip e2e]Fix comment typo (#14178)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:28:20 +08:00
godchen
817182f48f
[skip e2e]Fix comment typo (#14184)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:18:28 +08:00
godchen
acd792515d
[skip e2e]Fix comment typo (#14177)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:16:41 +08:00
godchen
8a2c3ecefd
[skip e2e]Fix comment typo (#14176)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:14:52 +08:00
godchen
85094a99fa
[skip e2e]Fix comment typo (#14175)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:13:10 +08:00
godchen
af7517d80b
[skip e2e]Fix comment typo (#14174)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:10:54 +08:00
godchen
7bead10aa8
[skip e2e]sort imports (#14183)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:08:42 +08:00
godchen
c52fa2412d
[skip e2e]Fix comment typo (#14185)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2021-12-24 17:02:50 +08:00