datacap/README.md

244 lines
11 KiB
Markdown
Raw Normal View History

2023-02-14 00:00:41 +08:00
<div align="center">
2023-06-10 14:42:19 +08:00
<img width=68 height=65 src="core/datacap-web/public/static/images/logo.png" />
2023-02-16 01:23:43 +08:00
2023-02-03 11:19:53 +08:00
# DataCap
2022-09-17 14:23:51 +08:00
2023-02-14 00:00:41 +08:00
---
![Visitors](https://api.visitorbadge.io/api/combined?path=https%3A%2F%2Fgithub.com%2FEdurtIO%2Fdatacap.git&countColor=%23263759&style=flat&labelStyle=none)
[![](https://tokei.rs/b1/github/EdurtIO/datacap)](https://github.com/EdurtIO/datacap)
![version](https://img.shields.io/github/v/release/EdurtIO/datacap.svg)
2023-04-21 11:07:26 +08:00
[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
2024-04-11 13:19:34 +08:00
![GitHub branch checks state](https://img.shields.io/github/checks-status/EdurtIO/datacap/dev?style=flat-square)
2023-02-14 00:00:41 +08:00
![GitHub Release Date](https://img.shields.io/github/release-date/EdurtIO/datacap?style=flat-square)
2023-04-21 11:07:26 +08:00
![Docker Automated build](https://img.shields.io/docker/automated/qianmoq/datacap)
![Docker Image Size (latest by date)](https://img.shields.io/docker/image-size/qianmoq/datacap?style=flat-square)
![Docker Pulls](https://img.shields.io/docker/pulls/qianmoq/datacap?style=flat-square)
2023-02-14 00:00:41 +08:00
![GitHub commit activity](https://img.shields.io/github/commit-activity/y/EdurtIO/datacap?style=flat-square)
![GitHub contributors](https://img.shields.io/github/contributors-anon/EdurtIO/datacap?style=flat-square)
![GitHub last commit](https://img.shields.io/github/last-commit/EdurtIO/datacap?style=flat-square)
</div>
### What is datacap?
---
2023-02-08 18:22:06 +08:00
DataCap is integrated software for data transformation, integration, and visualization. Support a variety of data sources, file types, big data related database, relational database, NoSQL database, etc. Through the software can realize the management of multiple data sources, the data under the source of various operations conversion, making data charts, monitoring data sources and other functions.
2022-09-17 15:36:31 +08:00
2023-03-21 20:24:15 +08:00
**Example**: [try.datacap.edurt.io](http://try.datacap.edurt.io/)
| Username | Password |
|:---------:|:------------|
| `datacap` | `123456789` |
2023-04-20 21:34:12 +08:00
| `admin` | `12345678` |
2023-03-21 20:24:15 +08:00
2022-09-17 15:36:31 +08:00
### Require
---
> Must-read for users: Be sure to execute the following command after cloning the code locally
```bash
cp configure/git-hook/* .git/hooks
chmod 700 .git/hooks/*
```
2023-02-08 18:22:06 +08:00
## Supported Connectors
2022-09-28 20:01:36 +08:00
---
2022-09-29 00:07:00 +08:00
DataCap can query data from any SQL-speaking datastore or data engine (ClickHouse, MySQL, Presto and more).
2022-09-28 20:01:36 +08:00
Here are some of the major database solutions that are supported:
2022-10-25 10:26:44 +08:00
<p align="center">
<a href="https://clickhouse.com" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/clickhouse.png" alt="ClickHouse" height="50" />
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://www.mysql.com" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/mysql.png" alt="MySQL" height="50"/>
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://prestodb.io/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/presto.png" alt="Presto" height="50"/>
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://redis.io/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/redis.png" alt="Redis" height="50"/>
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://www.postgresql.org/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/postgresql.png" alt="PostgreSQL" height="50"/>
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://trino.io/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/trino.png" alt="Trino" height="50"/>
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://www.elastic.co/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/elasticsearch.png" alt="ElasticSearch" height="50" />
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://druid.apache.org/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/druid.png" alt="Druid" height="50" />
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://kyuubi.apache.org/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/kyuubi.png" alt="Kyuubi" height="50"/>
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://hive.apache.org/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/hive.png" alt="Hive" height="50" />
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://kylin.apache.org" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/kylin.png" alt="Kylin" height="50" />
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://ignite.apache.org/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/ignite.png" alt="Ignite" height="50" />
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://www.ibm.com/db2/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/ibmdb2.png" alt="IBM DB2" height="50" />
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://www.mongodb.com/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/mongodb.png" alt="MongoDB" height="50" />
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://www.dremio.com/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/dremio.png" alt="Dremio" height="50" />
2022-10-28 00:13:05 +08:00
</a>&nbsp;
2022-10-25 10:26:44 +08:00
<a href="https://www.monetdb.org/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/monetdb.png" alt="MonetDB" height="50" />
2022-10-28 00:13:05 +08:00
</a>&nbsp;
<a href="https://phoenix.apache.org/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/phoenix.png" alt="Phoenix" height="50" />
2022-10-28 22:01:23 +08:00
</a>&nbsp;
<a href="https://www.h2database.com/html/main.html" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/h2.png" alt="H2" height="50" />
2022-11-09 10:50:15 +08:00
</a>&nbsp;
<a href="https://www.microsoft.com/sql-server" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/sqlserver.svg" alt="SqlServer" height="60" />
2022-11-10 19:43:26 +08:00
</a>&nbsp;
<a href="https://www.oracle.com/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/oracle.png" alt="Oracle" height="50" />
2022-11-17 22:26:16 +08:00
</a>&nbsp;
<a href="https://crate.io/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/cratedb.png" alt="CrateDB" height="50" />
2022-11-19 00:27:58 +08:00
</a>&nbsp;
<a href="https://www.dameng.com/DM8.html" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/dameng.png" alt="DaMeng" height="50" />
2022-11-27 15:52:26 +08:00
</a>&nbsp;
<a href="https://tdengine.com/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/tdengine.png" alt="TDengine" height="50" />
2022-11-28 16:31:08 +08:00
</a>&nbsp;
<a href="https://impala.apache.org/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/impala.png" alt="Impala" height="50" />
2022-11-30 23:16:46 +08:00
</a>&nbsp;
<a href="https://www.oceanbase.com/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/oceanbase.png" alt="OceanBase" height="50" />
2022-12-05 17:03:51 +08:00
</a>&nbsp;
<a href="https://neo4j.com/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/neo4j.png" alt="Neo4j" height="50" />
2022-12-06 15:33:36 +08:00
</a>&nbsp;
<a href="https://iotdb.apache.org/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/iotdb.png" alt="IoTDB" height="50" />
2023-01-29 10:54:36 +08:00
</a>&nbsp;
<a href="https://www.snowflake.com/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/snowflake.png" alt="Snowflake" height="70" />
2023-01-30 13:06:23 +08:00
</a>&nbsp;
<a href="https://ydb.tech/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/ydb.png" alt="YDB" height="50" />
2023-02-07 21:51:26 +08:00
</a>&nbsp;
<a href="https://zookeeper.apache.org/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/zookeeper.png" alt="Zookeeper" height="50" />
</a>&nbsp;
<a href="https://duckdb.org/" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/duckdb.png" alt="DuckDB" height="50" />
2023-02-24 14:18:16 +08:00
</a>&nbsp;
<a href="https://www.alibabacloud.com/zh/product/object-storage-service" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/alioss.png" alt="Aliyun OSS" height="50" />
2023-03-06 22:43:39 +08:00
</a>&nbsp;
<a href="https://kafka.apache.org" target="_blank">
2023-03-07 23:01:02 +08:00
<img src="docs/docs/assets/plugin/kafka.png" alt="Apache Kafka" height="50" />
2023-04-12 17:31:42 +08:00
</a>&nbsp;
<a href="https://docs.ceresdb.io/" target="_blank">
<img src="docs/docs/assets/plugin/ceresdb.png" alt="CeresDB" height="50" />
2023-04-14 13:48:28 +08:00
</a>&nbsp;
<a href="https://docs.greptime.com/" target="_blank" class="connector-logo-index">
<img src="docs/docs/assets/plugin/greptimedb.png" alt="GreptimeDB" height="70" />
2023-04-17 11:54:51 +08:00
</a>&nbsp;
<a href="https://questdb.io/" target="_blank" class="connector-logo-index">
<img src="docs/docs/assets/plugin/questdb.png" alt="QuestDB" height="50" />
2023-04-19 19:43:22 +08:00
</a>&nbsp;
<a href="https://doris.apache.org/" target="_blank" class="connector-logo-index">
<img src="docs/docs/assets/plugin/doris.png" alt="Apache Doris" height="50" />
2023-04-20 13:41:43 +08:00
</a>&nbsp;
<a href="https://www.starrocks.io/" target="_blank" class="connector-logo-index">
<img src="docs/docs/assets/plugin/starrocks.png" alt="StarRocks" height="50" />
2023-04-25 11:52:09 +08:00
</a>&nbsp;
<a href="https://www.alibabacloud.com/product/hologres" target="_blank" class="connector-logo-index">
<img src="docs/docs/assets/plugin/hologres.png" alt="Hologres" height=60" />
2023-04-28 15:19:09 +08:00
</a>&nbsp;
<a href="https://hadoop.apache.org/" target="_blank" class="connector-logo-index">
<img src="docs/docs/assets/plugin/hdfs.png" alt="Apache Hdfs" height=60" />
2023-05-06 17:52:13 +08:00
</a>&nbsp;
<a href="https://docs.pinot.apache.org/" target="_blank" class="connector-logo-index">
<img src="docs/docs/assets/plugin/pinot.png" alt="Apache Pinot" height=60" />
2023-06-06 22:58:42 +08:00
</a>&nbsp;
<a href="https://cassandra.apache.org/" target="_blank" class="connector-logo-index">
<img src="docs/docs/assets/plugin/cassandra.png" alt="Apache Cassandra" height=60" />
2024-01-12 12:22:10 +08:00
</a>&nbsp;
<a href="https://matrixorigin.cn/" target="_blank" class="connector-logo-index">
<img src="docs/docs/assets/plugin/matrixone.png" alt="MatrixOne" height=60" />
</a>&nbsp;
2024-01-12 14:03:13 +08:00
<a href="https://www.scylladb.com/" target="_blank" class="connector-logo-index">
<img src="docs/docs/assets/plugin/scylladb.png" alt="ScyllaDB" height=60" />
</a>&nbsp;
2024-02-05 12:48:57 +08:00
<a href="https://www.paradedb.com/" target="_blank" class="connector-logo-index">
<img src="docs/docs/assets/plugin/paradedb.png" alt="ParadeDB" height=80" />
</a>&nbsp;
<a href="https://www.timescale.com/" target="_blank" class="connector-logo-index">
<img src="docs/docs/assets/plugin/timescale.png" alt="Timescale" height=60" />
</a>&nbsp;
2022-10-25 10:26:44 +08:00
</p>
2022-09-28 20:01:36 +08:00
2024-01-11 12:17:14 +08:00
## System architecture
---
<img src="docs/docs/assets/architecture.jpg" width="100%" />
## Stargazers over time
---
2023-08-09 16:34:43 +08:00
[![Star History Chart](https://api.star-history.com/svg?repos=devlive-community/datacap&type=Timeline)](https://star-history.com/#devlive-community/datacap&Timeline)
## Join Us
---
2023-04-21 10:51:01 +08:00
Open the DingTalk (left) or WeChat(right) software and scan the following QR code to join
2023-05-06 18:42:35 +08:00
<div>
<img src="docs/docs/assets/dingtalk.png" width="200px" height="200px"/>
<img src="docs/docs/assets/wechat.png" width="200px" height="200px"/>
</div>
## Thank you
---
2023-04-21 11:07:26 +08:00
[![Jetbrains](https://img.shields.io/badge/Development-Jetbrains-brightgreen?style=flat-square)](https://www.jetbrains.com/)
[![App Store](https://img.shields.io/badge/App%20Store-Rainbond-brightgreen?style=flat-square)](https://www.rainbond.com/)
2023-09-05 16:01:19 +08:00
[![View UI Plus](https://img.shields.io/badge/UI-View%20UI%20Plus-brightgreen?style=flat-square)](https://www.iviewui.com/view-ui-plus)
## Installation and Configuration
---
2023-08-09 16:34:43 +08:00
[Extended documentation for DataCap](https://datacap.edurt.io)
## Contributors
---
2023-02-03 11:19:53 +08:00
<a href="https://github.com/EdurtIO/datacap/graphs/contributors">
<img src="https://contrib.rocks/image?repo=EdurtIO/datacap" />
</a>