Welcome to the new Meltano Changelog!
This is going to be our new place to share and keep a record of all of the product updates happening around the Meltano ecosystem. Previously we'd shared these in our newsletter and in Slack. We'll likely keep putting updates there, but this will be the primary destination for updates going forward.
Let's dive in to what's improved over the past month or so!
☁️ Meltano Cloud entered Public Beta
Right at the end of May this year we launched Meltano Cloud into Public Beta. This was a key milestone for us at it represented the threshold where early Alpha users were seeing enough value to pay for Cloud use. And it means we can start working through our large waitlist to onboard more users.
Request Access to the Meltano Cloud Beta
Since then we've:
- Added the ability to cancel a running job from the CLI
- Added syntax highlighting to the logs in the Cloud UI
- Added support for manual, once, and none aliases for schedules. Useful for one-off runs!
- Improved the error code response when creating or updating a deployment
- Squashed quite a few bugs. Thanks to our early users for all of their feedback!
Core
We released v2.20.0 which was primarily a bugfix and documentation release. We're also incrementally starting to improve the settings definitions for plugins. We now recommend using hidden: true
instead of kind: hidden
on plugins. This is part of an effort to make kind
indicate just the data type and not any sort of UX choices that may be desired.
MeltanoHub
The Meltano Community has been busy adding new connectors to MeltanoHub. In June and July so far we've had the following additions and updates:
Extractors
- Updated the Google Analytics connectors and docs due to the GA4 change - Link
- Added the MeltanoLabs variant of tap-hubspot - Link
- Added the datarts-tech variant of tap-cassanda - Link
- Added the acarter24 variant of tap-mailchimp - Link
- Updated the default variant fo SaaSOptics to the datarts-tech variant - Link
- Updated the default variant of tap-postgres and tap-snowflake to the MeltanoLabs variant - Link
- Added tap-theme-parks - Link
- Added the sehnem variant of tap-netsuite - Link
- Updated the default variant of tap-recruitee to the rawwar variant - Link
Loaders
- Added a loader for Clickhouse - Link
- Added target-sqs and target-parquet variants from Hotglue - Link
- Updated the default variant of target-postgres and target-snowflake to the MeltanoLabs variant - Link
We've also got an introductory video on how to go from Zero to Snowflake with the help of target-snowflake.
Connectors
We're continuing to invest in building first-party connectors based on the Meltano SDK.
We also have new extractors for Jira and Salesforce landing soon.
SDK
We shipped 3 SDK releases
Some highlights from these releases are:
- Supporting optional headers in OAuth requests
- Publishing the supported python version in
--about
- Supporting union schemas which is useful for connectors that accept mutually exclusive settings (e.g. OAuth vs API key auth)
- Validation of a parsed/transformed record against the SCHEMA message
- Add Apache 2.0 as an optional license when developing a connector
And of course lots of fixes, under the hood changes, and improved documentation.