Components

• srcd/sourced-ui has been updated to v0.7.0.
• srcd/gitcollector has been updated to v0.0.4.

Fixed

• More detailed error messages for file downloads (#245).

Changed

• Make sourced-ui Superset celery workers run as separate containers (#269).

Internal

• Development and building of source{d} CE now requires go 1.13 (#242).

Upgrading

Install the new v0.17.0 binary, then run sourced compose download. Because of a change in the docker-compose.yml file version, you must delete the file ~/.sourced/compose-files/__active__/docker-compose.override.yml manually.

If you had a deployment running, you must re-deploy the containers with sourced restart. All your existing data will continue to work after the upgrade.

$ sourced version
sourced version v0.16.0

$ rm ~/.sourced/compose-files/__active__/docker-compose.override.yml

$ sourced compose download
Docker compose file successfully downloaded to your ~/.sourced/compose-files directory. It is now the active compose file.
To update your current installation use `sourced restart`

$ sourced restart

Components

• srcd/sourced-ui has been updated to v0.6.0.
• bblfsh/web has been updated to v0.11.3.

Fixed

• Increase the timeout for the start command (#219).

Changed

• sourced compose list shows an index number for each compose entry, and sourced compose set now accepts both the name or the index number (@cmbahadir) (#199).

Upgrading

Install the new v0.16.0 binary, then run sourced compose download. If you had a deployment running, you can re-deploy the containers with sourced restart.

Please note: sourced-ui contains changes to the color palettes for the default dashboard charts, and these changes will only be visible when you run sourced init local/org with a new path or organization. This is a cosmetic improvement that you can ignore safely.

If you want to apply the new default dashboards over your existing deployment, you will need to run sourced prune (or sourced prune --all) and sourced init local/org again.

Important: running prune will delete all your current data and customizations, including charts or dashboards. You can choose to not prune your existing deployments, keeping you previous default dashboards and charts.

$ sourced version
sourced version v0.16.0

$ sourced compose download
Docker compose file successfully downloaded to your ~/.sourced/compose-files directory. It is now the active compose file.
To update your current installation use `sourced restart`

$ sourced status workdirs
  bblfsh
* src-d

$ sourced prune --all
$ sourced init orgs src-d
$ sourced init orgs bblfsh

Fixed

• Fix incompatibility of empty resource limits (#227).
• Fix incorrect value for GITCOLLECTOR_LIMIT_CPU in some cases (#225).
• Fix gitbase LOG_LEVEL environment variable in the compose file (#228).

Removed

• Remove the completion sub-command on Windows, as it only works for bash (#169).

Upgrading

Install the new v0.15.1 binary, then run sourced compose download.

For an upgrade from v0.15.0, you just need to run sourced restart to re-deploy the containers.

For an upgrade from v0.14.0, please see the upgrade instructions in the release notes for v0.15.0.

Components

• srcd/sourced-ui has been updated to v0.5.0.
• srcd/ghsync has been updated to v0.2.0.

Added

• Add a monitoring of containers state while waiting for the web UI to open during initialization (#147).
• Exclude forks by default in sourced init orgs, adding a new flag --with-forks to include them if needed (#109).

Changed

• Refactor of the status command (#203):
  • sourced status components shows the previous output of sourced status
  • sourced status workdirs replaces sourced workdirs
  • sourced status config shows the contents of the Docker Compose environment variables. This is useful, for example, to check if the active working directory was configured to include or skip forks when downloading the data from GitHub
  • sourced status all shows all of the above

Upgrading

Install the new v0.15.0 binary, then run sourced compose download. If you had a deployment running, you can re-deploy the containers with sourced restart.

Please note: sourced-ui contains fixes for the default dashboard charts that will only be visible when you run sourced init local/org with a new path or organization.
If you want to apply the new default dashboards over your existing deployment, you will need to run sourced prune (or sourced prune --all) and sourced init local/org again.

Important: running prune will delete all your current data and customizations, including charts or dashboards. You can choose to not prune your existing deployments, keeping you previous default dashboards and charts.

$ sourced version
sourced version v0.15.0 build 08-21-2019_08_30_24

$ sourced compose download
Docker compose file successfully downloaded to your ~/.sourced/compose-files directory. It is now the active compose file.
To update your current installation use `sourced restart`

$ sourced status workdirs 
  bblfsh
* src-d

$ sourced prune --all
$ sourced init orgs src-d
$ sourced init orgs bblfsh

Release v0.14 of source{d} Community Edition (CE), the data platform for your software development life cycle.

The sourced binary is a wrapper for Docker Compose that downloads the docker-compose.yml file from this repository, and includes the following sub commands:

• init: Initialize source{d} to work on local or GitHub organization datasets
  • local: Initialize source{d} to analyze local repositories
  • orgs: Initialize source{d} to analyze GitHub organizations
• status: Show the status of all components
• stop: Stop any running components
• start: Start any stopped components
• logs: Show logs from components
• web: Open the web interface in your browser
• sql: Open a MySQL client connected to a SQL interface for Git
• prune: Stop and remove components and resources
• workdirs List all working directories
• compose: Manage source{d} docker compose files
  • download: Download docker compose files
  • list: List the downloaded docker compose files
  • set: Set the active docker compose file
• restart: Update current installation according to the active docker compose file

Known Issues

• On Windows, if you use sourced init local on a directory with a long path, you may encounter the following error:

  Can't find a suitable configuration file in this directory or any
  parent. Are you in the right directory?
  

  This is caused by the MAX_PATH limitation on windows. The only workaround is to move the target directory to a shorter path, closer to the root of your drive (#191).

• Linux only: Docker installed from snap packages is not supported, please install it following the official documentation (#78).

Upgrading

For internal releases we don't support upgrading. If you have a previous sourced-ce pre-release version installed, clean up all your data before downloading this release. This will delete everything, including the UI data for dashboards, charts, users, etc:

sourced prune --all
rm -rf ~/.sourced

Fixed

• The internal directory structure in ~/.sourced/workdirs/ has changed to avoid bugs related to how some paths were base64-encoded and other were not. Now all working directories for init local or init orgs use base64 directory names (#173).
• Better error messages (#177).
• Update the .env file on init always (#181).

Internal

• Add support for a new docker-file.override.yml file, needed to setup a development environment for sourced-ui (#158).
• Improvements to integration tests for windows(#171, #178).

Upgrading

For internal releases we don't support upgrading. If you have a previous sourced-ce version installed, clean up all your data before downloading this release. This will delete everything, including the UI data for dashboards, charts, users, etc:

sourced prune --all
rm -rf ~/.sourced

Changed

• Use info as the default log level for the containers (#159).

Fixed

• The ~/.sourced directory is now created correctly on init (#160).

Upgrading

For internal releases we don't support upgrading. If you have a previous sourced-ce version installed, clean up all your data before downloading this release. This will delete everything, including the UI data for dashboards, charts, users, etc:

sourced prune --all
rm -rf ~/.sourced

Known Issues

Due to #160, after installing you will need to create the ~/.sourced directory manually, running:

mkdir ~/.sourced

Changed

• Update sourced-ui to v0.4.0-rc.2.
• Update ghsync to v0.2.0-rc.1.
• Update gitcollector to v0.0.3.

Fixed

• sourced workdirs shows an error when ~/.sourced does not exist (#144).

Upgrading

For internal releases we don't support upgrading. If you have a previous sourced-ce version installed, clean up all your data before downloading this release. This will delete everything, including the UI data for dashboards, charts, users, etc:

sourced prune --all
rm -rf ~/.sourced

Changed

• Update sourced-ui to v0.4.0-rc.1
• Improve the docker-compose.yml file (#136, #137)

Upgrading

For internal releases we don't support upgrading. If you have a previous sourced-ce version installed, clean up all your data before downloading this release. This will delete everything, including the UI data for dashboards, charts, users, etc:

sourced prune --all
rm -rf ~/.sourced

If you have dashboards created using previous versions of sourced-ce execute these commands before export:

cd ~/.sourced/workdirs/__active__
docker-compose exec sourced-ui bash
wget https://gist.githubusercontent.com/smacker/531afcf61c60012bc35cc73d89d661b4/raw/83f997251324abde08404cc2e3f278f8cc4de1f8/update_dashboards.py
python update_dashboards.py

Added

• New command sourced restart: Update current installation according to the active docker compose file
• New command sourced logs: Show logs from components
• The command sourced sql now also accepts an argument to run a query directly, e.g. sourced sql "show databases"

Changed

• Update gitcollector to v0.0.2
• Update gitbase to v0.23.1
• Update sourced-ui to v0.4.0-beta.2
• Use alpine based docker images (#130)

Upgrading

For internal releases we don't support upgrading. If you have a previous sourced-ce version installed, clean up all your data before downloading this release. This will delete everything, including the UI data for dashboards, charts, users, etc:

sourced prune --all
rm -rf ~/.sourced