Currently, our Python API code is a module in apache/dolphinscheduler codebase,
each time users change Python API code, they need to run all requests CI check
for dolphinscheduler and Python API, But if the user does only change Python
code, it could be merged if Python API CI pass and do not dependent on others CI.
Besides, we release Python API as the same version of dolphinscheduler. It is
easy for user to match Python API version. But when Python API does not change
any code, but dolphinscheduler release a bugfix version, Python API has to
release the new version to match dolphinscheduler. This happened when we
released Python API 2.0.6 and 2.0.7. 2.0.6 and 2.0.7 is bugfix version, and
Python API does not change any code, so the PyPI package is the same.
Separate Python API also makes our code more sense, we will have more
distinguished code in dolphinscheduler and Python API new repository.
Have separate issue tracker and changelog for information to users.
ref PR in other repository: apache/dolphinscheduler-sdk-python#1
see more detail in mail thread: https://lists.apache.org/thread/4z7l5l54c4d81smjlk1n8nq380p9f0oo
* [python] Add tox for out of box test
* Add `tox` for easy and complete test
* Correct package data attribute
* Add more dirs in flake8 ignore
* Change GA from raw to tox
* Fix env setter
* Temp skip sanity
* Rm not exists job
* Add code test
* fix
* rm all need
* fix
* fix
* fix
* fix
* fix
* fix
* Migrate pip upgrede to tox setting
* Change install_commands to commands
* fix config of install command
* Add GA env to do that
* Fix env error
* Finial commit
* remove duplicate
* Change doc
* Change dependence of ci
* Change dependence of ci
* Split the components into individual package
A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
* Split the components into individual package
A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
* Split the components into individual package
A follow-up PR will be made to build dedicated Docker images for each
component, so that every component Docker image has minimal jars, which
is easy to maintain and good for security fixes.
* [ci] Add coverage check in CI
* Coverage add dependent
* Install pydolphinscheduler before run coverage
* Up test coverage to 87% and down threshold to 85%
* Fix code style
* Add doc about coverage
* * add presto datasource support
update .gitigonre to igonre some files
* * use another presto driver
* * add LICENSE files about presto-jdbc
* * just for test sonar
Co-authored-by: rockxsj <junjun@mgtv.com>
* Add a script to check the license
### Motivation
Check licenses in the distribution package
### Modification
1. Add a script to check licenses, and list known licenses.
1. Remove unused dep license, lombok.
1. Remove unnecessary ignored patterns in .gitignore.
1. Add missing config items to apache-rat plugin, which just checked a small part of files before.
1. Add check to GitHub Actions process
### Result
1. Newly-added dependencies should be checked and confirmed.
1. Closes#1578
* Separate rat and dependency check
* Tee dependencies to stdout
* Add more debug messages
* Check light-weight task first
* Add a script to check the license
### Motivation
Check licenses in the distribution package
### Modification
1. Add a script to check licenses, and list known licenses.
1. Remove unused dep license, lombok.
1. Remove unnecessary ignored patterns in .gitignore.
1. Add missing config items to apache-rat plugin, which just checked a small part of files before.
1. Add check to GitHub Actions process
### Result
1. Newly-added dependencies should be checked and confirmed.
1. Closes#1578
* Separate rat and dependency check
* Tee dependencies to stdout
* Add more debug messages
* Check light-weight task first
* rename from DatasourceUserMapper to DataSourceUserMapper
* add unit test in UserMapper and WorkerGroupMapper
* change cn.escheduler to org.apache.dolphinscheduler
* add unit test in UdfFuncMapperTest
* add unit test in UdfFuncMapperTest
* remove DatabaseConfiguration
* add ConnectionFactoryTest
* cal duration in processInstancesList
* change desc to description
* change table name in mysql ddl
* change table name in mysql ddl
* change escheduler to dolphinscheduler
* change escheduler to dolphinscheduler
