We’re excited to announce the Common Availability of Lakeflow Join for Salesforce and Workday. Lakeflow Join introduces no-code ingestion connectors for fashionable SaaS functions, databases, and file sources—enabling you to construct scalable ingestion pipelines and unlock the total energy of your knowledge with the Databricks Knowledge Intelligence Platform. The Salesforce and Workday connectors are the primary managed connectors to be launched to GA because the Lakeflow Join announcement final July, with many extra on the way in which.
Lakeflow Join’s managed knowledge connectors are powered by serverless compute and can be found throughout AWS, Azure and GCP. They’re totally built-in with the Knowledge Intelligence Platform for governance, observability and enterprise safety.
Lakeflow Join is the primary of three elements launched as a part of Lakeflow, the unified engineering resolution for ingestion, transformation and orchestration. It really works seamlessly with DLT for transformation and Databricks Workflows for orchestration.
Early adopters like Porsche Holding, Insulet, Equiniti, Stroër SE & Co. and Flick are already utilizing Lakeflow Join to unravel a few of their hardest knowledge challenges.
Knowledge silos trigger ingestion complexity, inefficiency
At present, it’s troublesome to construct and preserve ingestion pipelines for SaaS functions your self as a result of every API is exclusive and modifications usually. In the meantime, database ingestion will be much more complicated, usually requiring additional infrastructure akin to digital machines for extraction instruments, Kafka for streaming, and a robust understanding of change knowledge seize (CDC) applied sciences for environment friendly ingestion.
In consequence, organizations spend quite a lot of time constructing, optimizing, and sustaining a patchwork of pipelines. This slows down initiatives and may create a fragmented ETL structure that’s troublesome to manipulate. It additionally forces extremely expert knowledge engineers to spend time shifting knowledge and monitoring pipelines as an alternative of creating strategic improvements.
Constructed-in knowledge ingestion assist for Salesforce and Workday
Lakeflow Join eliminates these challenges by making it straightforward to create production-ready pipelines with a number of clicks within the UI or a number of strains of code. Below the hood, ingestion is environment friendly, with incremental updates and optimized API utilization. As your managed pipelines run, we deal with schema evolution, seamless third-party API upgrades, and complete observability with built-in alerts.
“With the Salesforce connector, we efficiently decommissioned 4 companies, which considerably streamlined our tech stack and lowered our prices. This integration not solely simplified our structure but additionally improved our operational effectivity, permitting us to concentrate on delivering extra worth with fewer sources.”
— Simon Salmeri, Head of Knowledge Platform, Ströer
Lakeflow Join for Salesforce permits you to pair Databricks’ superior analytics and AI instruments with Salesforce’s CRM knowledge to construct a simpler vendor expertise: predicting gross sales developments, deepening insights into buyer behaviors, and personalizing engagement methods. The connector helps Salesforce-specific necessities, like customized objects and system fields.
“We’ve been utilizing the Lakeflow Join Salesforce connector for a advertising and marketing segmentation use case. Our Salesforce knowledge holds essential details about our clients, and the connector has been the lacking piece to convey this dataset into our lakehouse.… We are actually at just the start of understanding our clients higher and bettering their expertise.”
— Ana-Maria Mocanu, Knowledge and Insights Lead, Flick
Databricks and Salesforce introduced a strategic partnership in 2023 to construct strong integrations for our joint clients. Since then, we launched the zero-copy Salesforce Knowledge Cloud Connector so clients can uncover, question, and govern Salesforce Knowledge Cloud instantly from Unity Catalog. Paired with Lakeflow Join for Salesforce, clients can use each their CRM knowledge and their CDP knowledge inside Databricks.
Lakeflow Join for Workday additionally gives easy, low-maintenance ingestion. You may entry customized Workday experiences for centralized analytics in your worker workforce.
Each connectors seamlessly combine with the Knowledge Intelligence Platform, so you need to use:
- DLT to remodel knowledge declaratively and replace transformations incrementally as knowledge continues to stream in
- Databricks Workflows to orchestrate these pipelines
- Databricks Asset Bundles (DABs) to handle steady integration and supply
- Superior analytics and machine studying instruments to drive enterprise worth
- Unity Catalog to manipulate your knowledge and pipelines
- Lakehouse Monitoring to keep up the standard of your knowledge
Driving high-value enterprise use instances
Lakeflow Join helps unlock high-value use instances throughout numerous industries, akin to understanding buyer conduct, analyzing HR knowledge, or figuring out upsell alternatives.
A typical use case is predicting buyer churn. Within the video under, we display how a retailer can do that by ingesting Salesforce buyer order knowledge and mixing it with buyer interactions throughout different channels for enriched insights.
Demo: How one can use Lakeflow Join for Salesforce to foretell buyer churn.
One other use case is making a buyer assist dashboard for executives and assist groups. You may even use LLMs to diagnose the developments that seem within the dashboard, as proven in this step-by-step weblog publish.
For human sources departments, the Workday connector might help observe and predict HR developments, akin to worker turnover. For instance, you may ingest related Workday experiences, remodel them with DLT, and incorporate the outcomes into an AI/BI dashboard.
A whole lot of shoppers utilizing Lakeflow Join
Clients are already ingesting knowledge from quite a lot of sources with Lakeflow Join.
As one of many world’s most profitable automotive firms, Porsche Holding Salzburg (Porsche) is Europe’s largest automotive retail firm with operations in 23 nations. Porsche needed to handle their knowledge integration challenges and streamline entry to their buyer knowledge in Salesforce Gross sales Cloud. Utilizing Lakeflow Join, Porsche was capable of ingest knowledge from Salesforce, remodel it in batch and streaming modes, and deploy and function the pipelines in manufacturing. At present, the Databricks Knowledge Intelligence Platform types the core of the Porsche group’s Knowledge Platform. Be taught extra about Porsche’s success utilizing Lakeflow Join.
“Utilizing the Salesforce connector from Lakeflow Join helps us shut a important hole for Porsche from the enterprise facet on ease of use and worth. On the client facet, we’re capable of create a totally new buyer expertise that strengthens the bond between Porsche and the client with a unified and never fragmented buyer journey.”
— Lucas Salzburger, Undertaking Supervisor, Porsche Holding
Insulet is a medical gadget firm that developed the Omnipod product platform, and so they had been an early adopter of Lakeflow Join. With a mission to simplify life for folks with diabetes and different situations, they sought to faucet into their CRM insights to higher perceive their buyer wants. They used the Salesforce connector to cut back their ETL latency from days to minutes—bettering the decision course of for his or her clients with close to real-time insights.
“The LakeFlow Join’s Salesforce connector was particularly essential because it allowed us to instantly ingest buyer suggestions, gross sales knowledge and repair interactions from the Salesforce CRM into Databricks. LakeFlow Join fully modified how we deal with Salesforce knowledge. We removed unreliable middleware and may now analyze all the things instantly in Databricks – sooner and with much less handbook effort.”
— Invoice Whiteley, Senior Director of AI, Analytics and Superior Algorithms, Insulet
Equiniti (EQ) is a worldwide chief in shareholder, pension, and remediation companies, and so they needed to centralize knowledge and insights into their operations. Utilizing Lakeflow Join for Salesforce, Workday, and SQL Server, EQ seamlessly solved for ingestion—thus liberating up important engineering expertise to concentrate on utilizing Mosaic AI to reinforce the client expertise for his or her 6,000 firms throughout 136 nations. For EQ, the power to seamlessly create no-code integrations to their core platforms helped them save time and extra prices, letting them concentrate on worth multipliers like Gen AI functions. Find out how EQ constructed a safe and unified knowledge and AI platform in three steps.
Getting began with Lakeflow Join
Knowledge groups can now use Lakeflow Hook up with construct environment friendly, incremental pipelines at scale, with just some clicks or strains of code. Get began right this moment with the Salesforce or Workday connector to assist unlock high-value use instances, akin to predicting buyer churn, working personalised buyer analytics, and figuring out upsell alternatives.
Lakeflow Join’s roadmap contains extra connectors like SQL Server, Google Analytics, ServiceNow, SFTP, SharePoint, and PostgreSQL. Keep tuned for extra bulletins this 12 months, or attain out to your Databricks account staff should you’re involved in becoming a member of a preview for early entry.
Lakeflow Join has a compute-based pricing mannequin. Salesforce and Workday, which run completely on serverless infrastructure will incur serverless DLT DBT expenses. See extra particulars on charges.
To get began with Lakeflow Join for Salesforce and Workday, you may evaluate the documentation or strive this resolution accelerator.
