Commit Graph

135 Commits

Author SHA1 Message Date
bigsheeper
a4ea2fb18a
Handle errors in DataNode and QueryNode flow graph (#17096)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-24 21:11:59 +08:00
zhenshan.cao
08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks (#17022)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-23 16:41:58 +08:00
Jiquan Long
c5149c7e85
Replace text codec of pb with binary codec (#16955)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-13 09:53:53 +08:00
Letian Jiang
b3eb2b1d0d
Support deltaLog loading on growing segment (#16903)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-05-12 11:59:53 +08:00
Xiaofan
92b6293be4
Fix QueryNode log level (#16604)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-07 10:27:51 +08:00
xige-16
515d0369de
Support string type in segcore (#16546)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
2022-04-29 13:35:49 +08:00
congqixia
bb69e09736
Use fmt.Errorf instead of string concat in querynode/segment.go (#16422)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-04-25 16:11:48 +08:00
Xiaofan
89b4a34892
Fix Data race in NodeID (#16603)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-24 22:03:44 +08:00
xige-16
99984b88e1
Support delete varChar value (#16229)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-04-02 17:43:29 +08:00
Jiquan Long
ba37531456
Add support for loading multiple indexes (#16138)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-30 21:11:28 +08:00
Ji Bin
3cd28420f1
Support compile under windows (#15786)
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
zhenshan.cao
f3eeecf146
Reduce the number of metrics (#16030)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-15 21:51:21 +08:00
bigsheeper
caf9cbfcd4
Fix load failure and remove parition release related code (#16038)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-14 23:18:02 +08:00
cai.zhang
88527fc0a9
Fix metrics label conflict (#15839)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-03 16:05:57 +08:00
bigsheeper
12eb8c3da5
Add prometheus metrics for QueryNode (#15649)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-02 14:49:55 +08:00
godchen
fcf0887d92
Add and implement chunk manager interface. (#15541)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-02-24 23:53:53 +08:00
yah01
684110bc9a
Avoid to copy during converting C bytes to Go bytes (#15551)
* Avoid to copy during converting C bytes to Go bytes

Signed-off-by: yah01 <yah2er0ne@outlook.com>

* Add BytesConverter to achieve no-copy converting C bytes to Go bytes

Signed-off-by: yah01 <yah2er0ne@outlook.com>
2022-02-15 14:17:48 +08:00
jaime
307a8ce535
Support compile and run on Mac (#15491)
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
2022-02-09 14:27:46 +08:00
xige-16
55cdc5aa35
Get indexInfo and segment size by queryCoord (#14207)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-02-08 21:57:46 +08:00
Ji Bin
d83f69bb21
Support windows compliation (#15448)
- remove dl dependency while compiling some lib under MSYS
- int types aligement in golang
- core/src/utils adaptation for compile under MSYS

issue: #7706

Signed-off-by: Ji Bin <matrixji@live.com>
2022-02-07 23:43:46 +08:00
bigsheeper
ebed1a68ff
Add log for segcore search (#15159)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-11 18:07:34 +08:00
xige-16
99315ce00e
Optimize recentlyModified's lock (#15120)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-10 23:17:36 +08:00
congqixia
1dcd06cc78
Add log file info for all kind of segment binlogs (#13606)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-19 20:00:42 +08:00
jaime
932b8f4b22
[skip ci] Fix grammar mistake in segment (#13541)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-16 22:30:00 +08:00
XuanYang-cn
b1ec235644
[skip ci]Update license for qn segment (#13193)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-10 20:59:42 +08:00
xige-16
8b2cd271c7
Improve querynode log (#13158)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-10 18:51:08 +08:00
cai.zhang
b4be8acc1d
Use read lock when only read the var (#12626)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-07 10:03:47 +08:00
cai.zhang
1f67ab4e09
Use read lock when only read the var (#12712)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-07 10:01:52 +08:00
cai.zhang
dd88083db7
Use read lock when only read the var (#12711)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-06 15:23:41 +08:00
cai.zhang
6c1a471570
Use read lock when only read the var (#12627)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-06 15:21:46 +08:00
Cai Yudong
1a806a174a
Support load collection with multiple vector column (#12630)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-03 11:29:33 +08:00
cai.zhang
deaf4a642c
Use write lock when writing the var (#12528)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-01 22:26:10 +08:00
Cai Yudong
dd0b36f3fb
Clean debug log (#12205)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-23 14:25:15 +08:00
bigsheeper
698071de6f
[skip ci] Fix golint error for segmentInsert (#11856)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 09:27:36 +08:00
bigsheeper
fc0a34f40d
[skip ci] Fix golint error for segmentDelete (#11855)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 09:25:40 +08:00
Cai Yudong
b0054f1b48
Update C API NewSegment (#11809)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 16:57:09 +08:00
Cai Yudong
34ae61d8e2
Move HandleCProto into query node (#11763)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 11:05:09 +08:00
Cai Yudong
5fdc6626cb
Change API retrieve return type from CProtoResult to CProto (#11555)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-12 10:04:49 +08:00
Cai Yudong
ca356d2811
Use API HandleCStatus to handle CStatus returned by CGo in query node (#11559)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-11 10:18:42 +08:00
xige-16
b6c7bc19d1
[skip ci] Add comments for VectorFieldInfo (#11595)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-10 23:48:06 +08:00
Cai Yudong
b5bc9b26d7
Rename getEntityByIds to retrieve (#11548)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-10 17:15:37 +08:00
zhenshan.cao
34c4ef06fc
[skip ci]Fix golint error in segment.go (#11203)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-03 23:50:14 +08:00
godchen
0d97549d84
Remove useless log (#11105)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 19:20:29 +08:00
godchen
a0a3a889e7
Add common endian for global use (#11092)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00
yukun
f7c0f5b3da
Add segmentLoadDeletedRecord in querynode (#10449)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 18:51:14 +08:00
yukun
fe1927c05d
Support delete in SegmentSealed (#10181)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 13:11:11 +08:00
godchen
8daeb0d519
Change bloom filter use pk (#10193)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-19 20:18:47 +08:00
godchen
24a6fc096b
Update query node bloom filter (#10109)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-18 20:08:42 +08:00
yukun
997e88d8c6
Add deleteMessage in flow_graph_insert_node (#9505)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-15 11:02:32 +08:00
elfisworking
d4232f88a2
For search funtion adding a round_decimal paramter to precision control (#8574)
Signed-off-by: elfisworking <zymustb@126.com>
2021-10-08 17:39:55 +08:00