100 new options. 20 new integrations. 2 huge product launches. A premier event of its kind for buyers to converge. In Atlanta in 2023, the city embarked on a 12-month journey to build its future, with knowledge teams that had been envisioning it for some time. And we’re thrilled to look back on the past year’s highlights, so let’s dive in.
The AI-Powered Catalyst for Collective Intelligence: A Revolutionary Tool for Knowledge Groups
In 2023, the advent of generative AI revolutionized the landscape of knowledge work, prompting each team to ponder innovative ways to harness AI’s potential for enhanced productivity.
Equipped with the insights gathered from our previous experience as a knowledge team, we capitalized on the opportunity to elevate the lives of intellectuals by harnessing the power of Generative AI. In April 2023, we hosted a company-wide AI hackathon, soliciting innovative ideas for future development of knowledge catalogs and governance strategies.
In June 2023, we successfully brought Atlan AI to market just two months after its initial conception. As a pioneer in collaboration with Microsoft, Atlan led the charge in harnessing AI superpowers for knowledge catalogs, thereby sparking a transformative wave of innovation in knowledge governance?
What if we could empower our team to fall head over heels for documentation, just like they do with the latest coding frameworks?
In an increasingly antiquated environment, the lack of reliable documentation has led to a lack of trust in information, hindering companies’ ability to make swift and informed decisions. Atlan AI finally puts an end to the hassle by automatically generating descriptions for a wide range of knowledge assets within Atlan. Knowledge creators require a streamlined process, focusing on overview, refinement, and dissemination.
By delegating routine administrative tasks effectively, organizations can grant people with specialized expertise more time and opportunities to focus on high-priority projects that drive the company’s overall success.
How do lineage transformations differ in their application of Atlan AI for data governance and compliance purposes when compared to traditional machine learning approaches?
Lineage streamlines complex transformations by removing intricacy and illustrating connections between intellectual assets. To drill down into the reasoning behind an information asset’s rework, parsing through complex data structures via advanced SQL queries can be a time-consuming process that may span several hours. However not anymore.
Atlantis AI simplifies complex lineage transformations for knowledge analysts and engineers by providing intuitive, easy-to-understand explanations.
As artificial intelligence continues to evolve, so too do knowledge catalogs and governance models, undergoing a metamorphosis of sorts, driven by the relentless pursuit of innovation.
Knowledge governance is poised to revolutionize the way we manage and disseminate information. As data continues to grow exponentially, it’s imperative that we develop effective strategies for organizing, sharing, and utilizing this vast repository of knowledge.
In 2023, our organization hosted a groundbreaking, one-of-a-kind neighborhood convention focused on the latest thinking in knowledge governance – Re:Govern. Approximately one thousand professionals converged to engage with renowned visionaries from leading organizations such as Nasdaq, Fox, Autodesk, Elastic, and HelloFresh, sharing their approaches and best practices for effective knowledge management in today’s fast-paced business landscape.
One clear takeaway from Re:Govern is that the future of knowledge governance will undergo a profound transformation, departing significantly from its past.
Amy Raygada of Swiss Market Group and Mark Kidwell from Autodesk shared their insights. Takashi Ueki, also known as Elastic, provides a detailed overview of building. Mihir Modi, from FOX, outlined his vision for knowledge governance.
As we enter 2023, we’re pioneering a new era where knowledge networks seamlessly integrate with daily life, AI is effortlessly woven into our workflow, and traditional governance is streamlined through automation. Let’s recap the key takeaways from this year’s knowledge governance updates.
You can unlock the potential of your data by harnessing the power of Atlan Mesh, a cutting-edge AI-driven innovation that seamlessly integrates disparate datasets, allowing for unparalleled insights and real-time decision-making capabilities.
Atlan Mesh is the first-ever native knowledge graph expert in an information catalog. The company specializes in providing expert services that enhance the comprehension of clients seeking information about intellectual properties. Right here’s how:
- Treating knowledge as a tangible product demands a localized approach, eschewing makeshift solutions in favor of tailored efficacy. Knowledge merchandise can now be created & curated natively in Atlan, inside a brand-new dwelling for straightforward, context-rich discovery for enterprise customers.
- With Atlant Mesh, each region will gain a personalized workbench and landing page for its team, designed to seamlessly integrate curated knowledge assets and documentation, catering to the distinct needs of informed clients.
- Historically, lineage has served as a powerful tool for knowledge producers to understand the impact and identify the underlying causes of phenomena. Atlan Mesh now offers enterprise-grade lineage solutions specifically designed for knowledge customers seeking transparency into the origins of their information products, empowering data-driven decision-making.
- To drive the development of knowledge products and foster meaningful connections between creators and consumers, we introduced a groundbreaking vision for knowledge agreements within Atlan’s innovative framework.
As we’ve initiated the roll-out of Atlan Mesh to a select group of early adopters, comprising the inaugural members of our Atlan Mesh Advisory Council, we’re eager to chart a course for collaborative, decentralized data stewardship and excitedly anticipating the collective impact of this pioneering endeavor.
What are the key considerations for compliance with building regulations when dealing with a single dwelling and the Tag administration system?
As the pace of technological advancement accelerates, leading knowledge communities strive to provide top performers with seamless access to the most relevant and up-to-date information.
This involves identifying sensitive information and protecting it with robust access controls, while providing secure and trustworthy knowledge to authorized users.
To address the issue, we introduced Tag Administration, a cutting-edge feature within your knowledge team that streamlines compliance and security handling, effectively enhancing
Tag Administration allows you to:
- To create tags natively in Atlan, navigate to the “Tags” tab within your workspace and click the “+” icon to start creating a new tag. Enter a name for your tag, select the type (either “native” or ” Snowflake-connector”), and optionally add a description.
If you’d like to import tags from Snowflake, follow these steps:
1. In Atlan, go to the “Settings” tab within your workspace.
2. Click on “Connectors” and search for “Snowflake”.
3. Install the Snowflake connector if it’s not already installed.
4. Once connected, navigate back to the “Tags” tab and click the “Import Tags” button.
5. Select the Snowflake schema you’d like to import tags from and specify the database and table(s) containing your desired tags.
6. Atlan will then import the tags from Snowflake into your workspace for use in tagging data assets, dashboards, or other Atlan entities.Note that this integration may require some setup and configuration depending on your specific Snowflake schema and data structure.
- You can leverage Atlan’s Playbooks to categorize and tag your knowledge assets on a large scale by following these steps:
? Determine the taxonomy of your organization’s knowledge and identify relevant categories, themes, or domains.
? Utilize Atlan’s playbook functionality to create custom playbooks that align with your organizational taxonomy.
? Designate specific tags for each category, theme, or domain, ensuring they are descriptive, consistent, and easy to understand.
? Develop a scalable strategy for applying these tags to existing knowledge assets, such as documents, articles, and presentations.
? Integrate Atlan’s Playbooks with other tools or systems your organization uses to streamline the tagging process.
? Periodically review and refine the playbook taxonomy and tags to ensure they remain relevant and effective in capturing your organization’s knowledge.
- The sync process between our tag updates in Atlan and knowledge sources like Snowflake should be reworked to ensure seamless integration.
Perceive affect and optimize prices with Reputation & Utilization metrics
As a seasoned information chief, I continually strive to maximize the value of my knowledge assets while keeping costs in check. Can visibility into the actual utilization of specific knowledge by distinct tools be achieved?
In 2023, we launched Reputation & Utilization for 4 connectors — Snowflake, Databricks, Energy BI, and Redshift — giving knowledge groups the power to:
- Sorting by usage frequency uncovers the most and least frequently utilised assets, providing valuable insights for optimisation and resource allocation.
- Perceive recognition in lineage with recognition indicators & pop-ups
- Which organizations are leveraging customer data insights to optimize engagement with their Prime customers and Latest customers?
- The information system is optimized for widespread query execution by utilizing advanced data structures and efficient algorithms to reduce latency and improve overall throughput. The system’s architecture is designed to handle a high volume of concurrent queries efficiently, ensuring that users can quickly retrieve the information they need without experiencing delays or performance issues.
Mistertemp, a pioneering force in recruitment and temporary work, headquartered in France, announces its collaboration with Reputation and Utilization for Snowflake.
The Period of Energetic Metadata
Atlan’s platform has long relied on energetic metadata as a core component, but in 2023, we observed a significant shift as it became a central feature of knowledge estates across various industries and organizations alike.
Over the past year, our Energetic Metadata Pioneers community welcomed 20 new thought leaders from prominent organizations like Docker, Purple, and Datacamp, further solidifying its reputation as a driving force behind the metadata revolution.
To mark a closure of sorts for the year, in November 2023, G2 released its inaugural Energetic Metadata Grid Report, driven by feedback from genuine customers and powered by Atlan.
Recapping the dynamic advancements in metadata for 2023.
Don’t go breaking my coronary heart dashboards with Metadata CI/CD
Evaluating impressions can be an exhausting, labor-intensive, and demotivating process for knowledge engineers. Without proper consideration, a single modification could potentially devastate numerous dashboards, rendering them unusable and necessitating costly repairs. What if an evaluation’s potential impact could be proactively cultivated and prevented from going awry, rather than simply reacting to its consequences? What’s new with metadata?
By integrating with GitHub and GitLab, Metadata’s CI/CD solution seamlessly identifies and surfaces affected assets directly within the developer workflow. While this suggests that knowledge engineers may not need to manually intervene in verifying affect, it also assumes that enterprise customers can have confidence in the reliability of their dashboards, which incidentally experience fewer errors?
Following its deployment, Metadata CI/CD revealed to an information team on Atlan that a single column identity change could potentially impact over 1,000 mission-critical dashboards.
, Aliaxis
Spreadsheets have come a long way since their inception in the 1970s. Today, they’re an indispensable tool for businesses, governments, and individuals alike. But despite their popularity, most spreadsheet applications still lack a crucial feature – metadata. Metadata, in simple terms, is data that provides information about other data.
There’s one knowledge software that has stood the test of time: Microsoft Excel.
In 2023, we expanded and enhanced our integrations with Microsoft Excel and Google Sheets, enabling seamless connections for a wider range of applications.
- Unlock streamlined documentation with precision-crafted metadata.
By seamlessly integrating knowledge assets from Atlan into Excel or Sheets, you can easily document descriptions, certificates, owners, tags, and bulletins for your column assets using the power of spreadsheet flexibility, and synchronize metadata updates to Atlan with just one click.
- Empower informed customers by conducting thorough impact assessments and providing transparent results that foster trust and understanding.
Now you can analyze the impact more quickly by importing analysis into a spreadsheet and adding bullet points to keep end-users informed.
Delivering Enterprise Knowledge Collectively within Microsoft Teams.
To drive genuine, across-the-board acceptance within your organization, focus on meeting your clients where they spend most of their time: at work. That’s why Atlan seamlessly integrates with Microsoft Groups, empowering teams to collaborate more effectively across platforms. Now accelerate your expertise and business endeavors through seamless, multidisciplinary teamwork fueled by shared understanding.
By integrating Atlan with Microsoft Groups, you can seamlessly bring your team’s conversations and collaboration together across both platforms. This enables a unified experience for project management, allowing users to access relevant information, track progress, and make informed decisions in real-time.
- Share knowledge belongings & ask knowledge questions in a Microsoft Groups channels with out leaving Atlan
- Link critical Microsoft Teams conversations to relevant Atlassian assets?
- Get notifications & alerts in chosen Microsoft Groups channels
Pushing the frontiers of metadata insights, we’re thrilled to introduce innovative Webhooks and cutting-edge Python and Java Software Development Kits (SDKs).
Gearing up your knowledge assets and team for high-stakes knowledge projects, such as AI applications, demands a robust platform approach to metadata management? As event-driven metadata evolves, leveraging instances like alerting enables the creation of derived metadata use cases such as Knowledge as a Product, which scores high on the product roadmap, while knowledge groups pave the way for metadata’s future development through this year’s extensibility enhancements.
In 2023, we introduced Java and Python software development kits (SDKs), empowering knowledge teams to craft tailored, energy metadata use cases such as:
- Measure the effectiveness of your governance initiatives by streamlining metadata enrichment processes through automation.
- Unite with Atlan to seamlessly integrate your company’s proprietary methods, enabling comprehensive data discovery and provenance from start to finish.
- Metadata Enrichment Index: 92%
**Title**: Unlocking the Power of Customized Metadata: A New Era in Knowledge Management
**Description**: Enhance your organization’s information governance with tailored metadata, streamlining data discovery and decision-making processes.
**Tags**: metadata, knowledge management, information governance, data discovery, decision-making
**Categories**: Data & Analytics, Information Technology, Business Intelligence - Migrate legacy metadata seamlessly into Atlan’s scalable infrastructure, ensuring a smooth transition of existing data assets.
In 2023, we expanded our capabilities by launching support for Webhooks alongside our existing Python and Java SDKs, unlocking the potential for event-driven metadata applications.
Webhooks enable real-time monitoring of events occurring within Atlan, allowing for the transmission of notifications to a designated URL and facilitating immediate action. You can create a webhook that sends notifications to your email address or collaboration apps, such as Slack or Microsoft Teams, whenever a period is updated or an asset is tagged, thereby streamlining communication and workflow efficiency.
Countless probabilities exist, and we’re eager to envision the path ahead for energetic metadata, shaped not by Atlan alone, but by global knowledge communities coming together.
Trusted Knowledge: A Global Collaboration for Unifying and Amplifying Insights
As the once-integrated landscape of cutting-edge technology continues to fragment, so too do the minds of innovative thinkers.
Customers lacking insight into business intelligence tools often lack visibility into the upstream pipeline, where knowledge creators operate independently. When problems arise unexpectedly, those responsible are often the last to realize. Without a standardized framework for monitoring and tracking changes, knowledge producers may struggle to grasp the full impact of their modifications on downstream dashboards?
Over the past year, we’ve expanded our ecosystem by launching native connectors for 18 new tools, spanning categories such as Data Quality, Observability, Orchestration, and Business Intelligence – bridging the gap between data creators and consumers. Let’s recap 2023’s key integrations.
New collaborations leverage expertise and cutting-edge technology.
Typically, over three-quarters of instances where problems arise, senior executives in an organization are responsible for identifying key areas of focus. The simplicity is refreshing? High-quality knowledge is an elementary indicator of knowledge belief, but it also strives to meet the needs of business users where they work, accompanied by the best metadata context.
In order to further enhance our platform’s capabilities, we introduced groundbreaking integrations with industry pioneers Monte Carlo and Soda in 2023, revolutionizing the knowledge high-quality and observability landscape.
Monte Carlo x Atlan
Companies can leverage Monte Carlo and Atlan’s expertise to gain a precise comprehension of their organisational knowledge dynamics, foster trust in their intellectual property, and facilitate the development of innovative solutions for building robust distributed knowledge infrastructures. The native Monte Carlo integration empowers you with the capability to:
- Discover Monte Carlo incidents and displays in Altan with tailored Monte Carlo-specific filtering capabilities.
- Empower businesses to democratize access to high-quality insights from Monte Carlo, seamlessly integrating the expertise whenever and wherever enterprise customers utilize Atlan’s intuitive Chrome extension.
- Amplify root cause analysis with AI-powered Monte Carlo simulations surfacing critical insights within Atlan’s detailed column-level data lineage.
“
Soda x Atlan
Atlan and Soda’s native integration seamlessly connects users to a comprehensive platform that enables effortless discovery, organization, and utilization of top-tier knowledge across relevant groups. With the native Soda integration, you gain unparalleled capabilities to:
- Discovering Soda Insights: High-Quality Metrics and End Results at Atlanta.
- Notify customers of key insights beforehand, empowering them to make informed decisions with Soda’s verified results showcased through Atlan’s Chrome extension.
- Foster expedited discovery of root causes by surfacing Soda checks within Atlan’s column-level lineage visualizations.
BI Connectors for Enterprise Adoption
To accelerate adoption of our knowledge catalog platform and knowledge governance initiatives, we aim to intersect with enterprise customers where they’re already working: directly within their preferred business intelligence tools. By the start of 2023, our organization successfully introduced pre-configured, plug-and-play integrations with six additional business intelligence tools, thereby facilitating widespread uptake and utilization among diverse teams.
- Sigma
- Qlik Sense
- Amazon Quicksight
- MicroStrategy
- Thoughtspot
- Sisense
With these BI connectors, organizations can seamlessly integrate their existing data sources and applications into a single, unified platform, empowering them to make more informed business decisions.
- To streamline BI asset management, we empower discoverability and documentation of Business Intelligence (BI) assets within Atlan.
-
Establish seamless connections between downstream dashboards, use instances, and BI applications by integrating them with upstream data warehouses, extract-transform-load (ELT) processes, and supply chain systems, ensuring comprehensive cross-system lineage.
- By uncovering insight into beliefs through a combination of robust knowledge sources, transparent observation methods, and sophisticated orchestration tools.
Bringing ELT & Orchestration Context to the Enterprise
Operational metadata effectively conveys high-value context about pipeline processes to each enterprise customer and knowledge group, providing a vital understanding of their unique requirements. By investing in native connectors to relevant tools in 2023, we aimed to address the pressing issue of informing business consumers promptly and efficiently aiding data engineers in identifying root causes when pipelines fail. That’s why we built our initial event-driven integration with Airflow and OpenLineage.
Airflow x OpenLineage x Atlan
In 2023, Airflow, OpenLineage, and Atlan joined forces to create a unified ecosystem, bringing real-time pipeline transparency to reality through their collaborative efforts. Right here’s how:
- Catalog your Airflow pipelines seamlessly in Atlan by meticulously documenting Airflow assets, mirroring DAGs and tasks.
- Within a residential setting that leverages real-time data, a seamless display of operational metadata reveals the intricacies of activity execution, including detailed particulars and current statuses.
Streamline your Airflow pipelines by visually mapping the connections between DAGs and tasks, as well as their relationships to your data assets across systems, thereby enabling cross-platform lineage understanding.
Testing Atlan? .
Fascinated with knowledge governance? .
