Commit Graph

267 Commits

Author SHA1 Message Date
Ten Thousand Leaves
6f75d02c65
Disable knowhere logging for embedded Milvus and some other tweaks (#16496)
/kind enhancement

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-20 17:23:46 +08:00
Ten Thousand Leaves
cf9b9aba79
Fix a bug where RPC calls before proxy finishes initialization crashes Milvus (#16474)
/kind bug

issue: #16473
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-14 20:01:34 +08:00
jaime
ed3c29eae7
Support Kafka (#16149)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-04-12 19:47:33 +08:00
godchen
bb7a0766fe
Add dependency factory (#16204)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-04-07 22:05:32 +08:00
xiyichan
ca129d4308
Support configurable msgstream (#16131)
Signed-off-by: xiyichan <2863768433@qq.com>
2022-03-24 10:15:25 +08:00
Xiaofan
787d4f8bfd
Refine prometheus metrics and etcd log (#16084)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-18 15:51:22 +08:00
Ji Bin
3cd28420f1
Support compile under windows (#15786)
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
Ten Thousand Leaves
a3a29fed06
Add entry point for embedded Milvus. (#16008)
/kind feature

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-16 16:51:22 +08:00
Ten Thousand Leaves
d5bae6710f
Make all logs configurable for standalone/embedded Milvus. (#15926)
Resolves: #15919, #15708
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-10 10:35:59 +08:00
jaime
7a3a721380
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
Nemo
d1b8c9850b
Fix a bug for standalone where it appears that DEPLOY_MODE is get/used before set. (#15712)
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-02-24 14:41:52 +08:00
Xiaofan
be42627ab2
Move Logutil to Util dir (#15447)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-02-09 18:55:46 +08:00
Cai Yudong
1f337891e1
Rename base_param to service_param, rename global_param to component_param (#15463)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-08 20:57:47 +08:00
Cai Yudong
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
Cai Yudong
72a17339f5
[skip e2e] Remove SIGSEGV handling (#15341)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-21 20:03:38 +08:00
Cai Yudong
7b48dc7b84
[skip e2e] Add SIGSEGV handling (#15248)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-17 17:35:35 +08:00
congqixia
3cf44cb83f
Add automaxprocs (#14496)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-29 17:40:59 +08:00
Xiaofan
69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
Cai Yudong
d34bb26414
Set rolname when init GlobalParamTable (#14422)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-28 23:12:46 +08:00
Bingyi Sun
02e568603b
Add log with context in DataCoord (#14431)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-28 19:42:19 +08:00
Cai Yudong
891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
zhenshan.cao
c5d91af794
Enable pprof service (#13979)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-23 11:39:10 +08:00
congqixia
1dcd06cc78
Add log file info for all kind of segment binlogs (#13606)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-19 20:00:42 +08:00
Bingyi Sun
37705dfbbb
Add module name to logger in proxy (#13580)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-17 19:07:39 +08:00
Cai Yudong
78acb5fe5c
Update main to use role const (#13431)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-15 17:49:09 +08:00
Cai Yudong
024c1ac412
Let standalone share same LogCfg with distributed components (#13332)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-14 18:31:25 +08:00
dragondriver
78698a8918
Add log when healthz check return false (#13261)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-14 10:35:11 +08:00
jaime
b43b4e213f
[skip ci] Fix a grammar mistake in roles.go (#12604)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-13 09:29:50 +08:00
congqixia
d68f7602e5
Standalone healthz check include proxy and coordinator state check (#12812)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-07 13:33:43 +08:00
Xiangyu Wang
936b1a7f8b
Remove unused codes (#12780)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-06 18:20:31 +08:00
yukun
764cf1a53e
Add rocksmq server close when standalone exit (#12255)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-12-02 10:27:32 +08:00
dragondriver
b6d0150dc5
Fix health check when disconnect to etcd (#12292)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-26 11:39:16 +08:00
dragondriver
6c4c0ef6b5
Add more deploy metrics (#12248)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-24 15:43:15 +08:00
XuanYang-cn
7dbb4d10e5
Fix DeltaLogs empty yet appending a deltaInfo bug (#11984)
- Add more logs for startpositions

Fixes: #11970

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 17:57:11 +08:00
dragondriver
cc0d6dc6fd
Fix runtime path created by multiple processes (#11966)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-17 17:47:12 +08:00
Xiangyu Wang
12f50cb22c
[skip ci]Update OWNERS files (#11898)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
XuanYang-cn
9dcee0ae4d
Fix typo of ected to etcd (#11784)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-15 19:11:52 +08:00
congqixia
413aa42796
Add tool for datacoord segment meta (#11745)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-12 19:01:11 +08:00
Cai Yudong
124bd6c20a
Let param table init once (#11510)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-10 10:07:37 +08:00
dragondriver
4dd6051eb2
[skip ci] Fix golint warning of roles.go (#11024)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-01 22:35:18 +08:00
groot
fb71fd525a
[skip ci] Typo (#10823)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-28 18:02:30 +08:00
groot
bad79d9179
[skip ci] Add log (#10822)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-28 18:00:38 +08:00
dragondriver
807ccd0085
Register healthz router at once when component is created (#9722)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 19:25:44 +08:00
XuanYang-cn
307d6193d6
[skip ci]Update license in cmd/ (#9508)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-09 18:03:34 +08:00
dragondriver
30ecd3164f
[skip ci] Add desc comments for GetComponentStatesInterface (#9506)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-08 23:56:13 +08:00
Xiangyu Wang
81073c2f9d
[skip ci]Change name to account in OWNERS file (#9429)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-08 09:01:18 +08:00
Xiaofan
2c2b800ff4
Change Log Name with NodeId (#8721)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-01 08:52:50 +08:00
XuanYang-cn
c8f48f2e5b
[skip-ci]Fix golint in cmd/components (#8895)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-29 23:40:10 +08:00
XuanYang-cn
87b1d66d74
[skip-ci]Fix golint on cmd/components (#8896)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-09-29 23:20:11 +08:00
zhenshan.cao
d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-29 20:26:00 +08:00