Today we’re launching two new capabilities for Hex:
- First-class integrations with popular orchestration tools Airflow and Dagster
- A public API, allowing you to programmatically run Hex projects from other systems
Together, these represent a new set of super powers for integrating Hex in the rest of your stacks, workflows, and systems. We can’t wait to see where you take it!
🐙 Orchestration integrations: Airflow and Dagster
You can now schedule Hex apps to run as part of an Airflow DAG or Dagster job. This lets you keep apps up-to-date with your latest data syncs, or do ad-hoc runs with custom input values as part of a complex data pipeline.
Here's Friend of Hex, Pedram, with the details:
These orchestrated runs kick off a new run of the app, optionally set the user-facing cache, and return a link to that particular app run (and other metadata) that you can use downstream.
Airflow & Dagster integrations are available to workspaces on the Teams plan or higher.
🤖 Public API
We’ve also released a public API with all the endpoints you need to build your own version of these integrations, or something totally unique.
There’s four endpoints in v1.0.0: RunProject, GetRunStatus, CancelRun, and GetProjectRuns. Like the orchestration integrations, RunProject can be used both to trigger runs that set the user-facing cache of an app, or to generate custom one-off runs with specific input parameters.
See the full API docs here for more information. We can’t wait to see what you build!
API access is available to workspaces on the Teams plan or higher.
♻️ GitLab sync
Git sync now works with GitLab, in addition to GitHub. The flow is exactly the same, you can just add GitLab as a new source in addition to GitHub!
For more information on our version control workflows, check out the git sync docs.
Git sync is available to workspaces on the Teams plan or higher.
🏎️ BigQuery Acceleration
We updated our BigQuery data connector and those extra-large queries you’ve been writing will see some major performance improvements. In our tests, we've seen queries returning 250k rows run ~5x faster and even greater improvements for larger queries.
To get these improvements, you have to toggle on the “Use BigQuery Storage API” option in your data connection’s settings. You’ll also need to grant the "BigQuery Read Session User" role to the Google Cloud service account used for the connection.
👑 Admin workspace asset usage
Want to delete an old connection but nervous it might break production apps? Admins can now see how many projects reference each Data Connection, Secret, or Github package in a workspace.
Admins can also drill down into a list of those projects, which is extra powerful when coupled with…. dun dun dun….
👀 Revamped Project View Stats
We’ve made big updates to project view analytics, moving it up to the top bar and improving the “See more” view. You can see all-time view statistics, latest version views and recent trends, and a list of recent unique viewers.
Now you can easily find out if your latest app is a viral success, or if that connection you want to delete is being used by any active apps.
Other improvements
- We’ve made the markdown emoji picker less excitable, so it only shows up when you actually want to add an emoji and not just anytime you want to add a semicolon.
- Okta and other directory syncs should now happen much more quickly.
- Hex has better support for other languages like Japanese, Arabic, and Cyrillic in our rendered snapshots and images.
- We’ve improved sorting behavior in complex, multi-level pivot cells.
- We’ve improved Table Display cells ability to display pivoted DataFrames.