v0.5.0

New Features

• 🔥 Export experiment results as a Jupyter notebook! #81
• Per-metric data quality thresholds (min sample size and suspicious uplift percent)
• SDK Dev Mode now supports both the javascript and react SDKs and can be enabled in staging builds #79
• Specify the experiment status (running or stopped) when importing past experiments #82
• View Queries button now shows the exact rows returned from the database before any post-processing #81

Bug Fixes

• Fix broken number inputs in forms (switch to react-hook-form library) #78
• Bug in stddev correction for revenue metrics #69
• Error when sending invite emails to teammates 14cf152
• Fix division bug for Postgres/Redshift when metric values are integers #69
• Render modals inside portal to fix z-index issues #77
• Downgrade Typescript to 4.3.5 to fix ts-server bugs during development #81

Misc

• Switch docker base image from node-alpine to python-slim
• GrowthBook stats engine now available as a standalone python package on PyPi: gbstats #81
• Change name to GrowthBook (no space)
• Move javascript and react SDKs to this monorepo #79
• Add video tour link to getting started page 75ef52a
• Document all data quality checks

v0.4.0

New Features

• Custom per-metric risk thresholds #53
• Experiment-level dimensions #65
• Custom minimum experiment length (in days) when importing past experiments #60
• Export data sources, metrics, and dimensions from MongoDB to a config.yml file #56
• Easilly override default SQL queries right after connecting to a data source #55
• Warn about variation id mismatches in query results #63

Bug Fixes

• Fix Cannot read property 'forEach' of null when importing past experiments 641565f
• Error when selecting multiple metrics by tags b4488d4
• Variation Id input not showing up on edit form 3aa8c01
• Error when deleting a metric that is being used in an experiment 4368783
• Update dependencies and fix yarn warnings #48

Misc

• Better docs for SQL data sources and metrics 67f1ebb

v0.3.0

New Features

• Configuration via yml files #38
• Use S3 for file uploads #41
• Custom metric conversion windows #52
• Control the automatic experiment refresh frequency 2fa4c0a
• Option to connect to Postgres and Redshift with SSL 385d300

Bug Fixes

• Various Clickhouse bugs - date function names, non-equi joins, json response format, stddev function 3644548 0034530
• Broken yarn install on OSX c71b86a
• UnhandledPromiseRejectionWarning on failed SQL queries 83219ad
• Cannot read property '0' of null on experiment results 0ac0fb5
• Docs typo #51

Misc

• Document the statistics engine and link to stats whitepaper #39

v0.2.4

Changes

• New sharing and presentation feature #31
• Add MySQL and MariaDB data sources #35
• Switch experiments to use new async query engine #32
• [bug fix] Fix BigQuery date parsing bug a7efc68
• [docs] Improve docs on self-hosting and metrics 4a0dfe4

v0.2.3

Changes:

• Add PrestoDB/TrinoDB as supported datasources #25
• Better UI for displaying Bayesian risk in results #26
• Ability to tag metrics and add them in bulk to an experiment #27
• Support for guardrail metrics #30
• Better logging and error messages a57b796 860a287 0796406
• Allow customizing snowflake role 6721cc7
• Bug fix: variationIdFormat select box not working 503473f
• Bug fix: switch from UNION to UNION ALL in queries for better support 503473f
• Bug fix: use redshift default for sql formatting to properly handle table names with dashes 503473f

v0.2.2

Changes

• Link experiments to the idea that it originated from bedac49
• MongoDB performance optimizations 5c14815 278f3f0
• ⚡ Webhooks support #21
• Refactor Python stats engine and add a full test suite #22
• Automatically update running experiment results every 6 hours #24
• Add open source installation instructions to the docs and improve the readme #23 b8cffc9

v0.2.1

Major Changes

• Python client library 2aed4e4
• ClickHouse data source support #19
• New Bayesian stats back-end written in Python #20
• Add column to experiment results to show Bayesian Risk for each metric
• New visualization for "Percent Change" graph (Violin Plot vs Bar Chart)
• Improve implementation instructions and documentation

v0.2.0

Changes:

• Ability to configure data sources using SQL d3aa6a4
• New form to create an organization 7e7d903 06c9231 abeda1f
• New docs site template with darkmode 53da7b5 d7a70fd 61e3e27 d42cd08
• Add a code of conduct a92e904
• Docker build improvements 41278e9

v0.1.7

Changes

• Better onboarding process with Docker 8f53432 301e13a 97b7aaa f2e69b5 83f8352 6d3c725
• Better error messaging 4d1865c ea343bc d919ca1
• Bug fix: Incorrect display of inverse metrics results 0d04225

v0.1.6

Changes

• Better onboarding process for new organizations 08785d1
• Ability to define metrics using SQL directly bd73b96
• Show estimated time remaining for metrics to move past the minimum conversion threshold 0f1f513
• Bug fix: axis missing on results graph when a metric did not have enough conversions
• Bug fix: word wrapping on idea cards should not break small words
• Bug fix: telemetry data missing event properties