From Complexity to Clarity: How nib Achieved Data Discovery with Select Star

nib Group is an ASX100 health insurance company. It provides private health insurance and medical insurance to over 1.5 million Australian and New Zealand residents. Additionally nib is Australia’s third largest provider of travel insurance, providing travel insurance directly and through a global distribution network. nib has employees in Australia, the UK, USA and Ireland.

Industry:
Insurance
Company size:
1000+ employees
Integrations:
Snowflake
dbt
Tableau

Challenge

Lack of visibility into a growing data ecosystem

Moving from a legacy system to a modern data warehouse solution including Snowflake, dbt, Fivetran and Tableau, allowed nib to have multiple business areas working from the same tooling.

nib’s data models and products have been growing fast and nib’s data product portfolios include business lines across countries and jurisdictions that creates additional complexity with compliance, resilience and data sovereignty. 

The nib data team is responsible for the management of large datasets including over 10,000 data tables in Snowflake. The data teams are set up in squads aligned to business lines to establish subject matter expertise and improve efficiency. This helped progress work on data products but the business needed help to find the data it wanted, understand transformations and the sources of the data.

“There was more interest from the business to learn from our data but that raised more questions given the complexity of the data models. Questions such as; which claims dataset should I use, has it been tested or validated, where can I find the data I want, were all common questions for the data team” said Mat Finch, Head of Data & AI at nib.

To address these challenges, nib identified several key issues:

  1. Complex Data Lineage: Understanding and tracing data flow at the column level was painstakingly difficult but crucial for maintaining data integrity and helping end users understand the origins of data.
  2. Data Redundancy: Multiple instances of redundant data sets made it difficult to maintain consistency and efficiency. Identifying and eliminating these redundancies was essential for optimizing data management.
  3. Limited Visibility: Business users and analysts often struggled with visibility into data usage, impacting change management and feature development. Questions like “Where is this data coming from?” or “How is this metric calculated?” were common and could be time-consuming to answer.
  4. Data Governance: Ensuring consistent tagging and identifying PII (Personally Identifiable Information) within the datasets was a critical yet challenging task. Proper governance is necessary to comply with regulatory requirements and policies.

As a health insurer, nib works under stringent regulations around data privacy and security, such as APRA (Australian Prudential Regulation Authority). Ensuring compliance requires meticulous data management and governance, adding another layer of complexity to nib's challenges.

Lastly, nib also faced the challenge of aligning business units and data teams with a unified approach to data management. Different departments had varying levels of data literacy and access needs, making it difficult to implement a standardized solution across the organization. This fragmentation can often lead to inefficiencies and miscommunication, further complicating data management.

These challenges highlight the need for a comprehensive data discovery and governance solution. nib needed a solution that could help nib see the lineage of its data at a granular level and identify redundant datasets immediately.

testim icon

It [Select Star] makes understanding how a model works significantly quicker (from) being able to track the lineage and review the code. Select Star quickly became our first port of call

Data Manager at nib

Solution

Self-service discovery powered by automated metadata insights

nib partnered with Select Star to tackle these challenges, leveraging its robust data discovery and lineage features to enhance data management practices. The implementation included several key components:

  • Column-Level Lineage: Select Star provided detailed insights into data transformations and usage across tables, enabling users to trace the origin and journey of each data element. One data manager at nib said “It makes understanding how a model works significantly quicker (from) being able to track the lineage and review the code. Select Star quickly became our first port of call”.
  • Data Deduplication: The intuitive search capabilities of Select Star allowed nib to quickly identify and remove redundant datasets, ensuring a more streamlined and efficient data environment.
  • Enhanced Visibility: Business users and engineers gained the ability to easily see where data was being used, which Tableau reports it fed into, and make informed decisions about data changes. This improved accessibility significantly reduced the time needed to find and understand data.
  • Tagging and PII Identification: Select Star’s tagging feature facilitated better data governance by making tagging efforts consistent and visible, helping to ensure compliance with regulatory requirements and internal policies.

nib found Select Star’s user-friendly interface catered to both technical and non-technical users, helping bridge the gap between data teams and business users and improving data literacy and collaboration across the organization. Select Star’s automated documentation and reporting features further simplified data management tasks, allowing teams to focus on strategic initiatives rather than routine maintenance.

The evaluation process for Select Star involved a thorough comparison with other leading data discovery and governance tools from Gartner’s magic quadrant. nib's decision-makers prioritized features such as ease of use, depth of data lineage insights, ability to automate data ingestion and the being able to handle complex data environments. Select Star stood out due to its ability to provide column-level lineage, intuitive interface, and strong support for data governance.

testim icon

Data Manager at nib

Result

90% increase in efficiency and transparency / trust in data

The deployment of Select Star at nib led to significant improvements across various facets of their data management processes:

  • Improved Efficiency: The analytics team reported a dramatic reduction in the time needed to answer data-related questions, enhancing overall productivity. This efficiency enabled analysts to focus more on strategic tasks rather than spending time searching for data.
  • Faster Data Model Migration: With a clear understanding of how existing data assets were both structured and being used, nib was able to speed up their migration to new data pipelines. Knowing both the datasets and the dashboards that are connected enabled notification to users of any changes much simpler.
  • Reduced Redundancy: nib successfully decommissioned 100+ tables and dashboards that were either unused or redundant, streamlining their data environment and reducing maintenance efforts. 
  • Enhanced Data Governance: Consistent and accurate tagging improved data governance and minimized errors in data handling, ensuring compliance with industry regulations and internal policies. This improvement was crucial for maintaining the integrity and security of sensitive information.

With Select Star, nib has noticed an important shift in the data culture. Teams became more proactive in their data management practices, leveraging the insights provided by Select Star to drive innovation and efficiency. The improved data governance and visibility also contributed to higher confidence in data-driven decision-making across the organization.

nib also noted a significant improvement in compliance with regulatory standards and ensuring better protection of customer information. This compliance was essential for maintaining customer trust and meeting industry standards.

nib has found Select Star to be very open to product feature ideas and have been working as a partnership to get even more value from the product and nib’s looks forward to seeing the continuous development of features with each new release.

Overall, Select Star transformed nib's data management, making it more efficient, transparent, and manageable, ultimately supporting their mission to deliver exceptional service to their members.

More Customer Stories

Wallbox Gains Clarity and Control in Data Governance with Select Star
Learn More
Faire Slashes Data Pipeline Costs by 70% with Snowflake and Select Star
Learn More
AlphaSense Transforms their BigQuery Data Warehouse with Select Star
Learn More
Turn your metadata into real insights