Launch of an inside information market with Atlan
The Lively Metadata Pioneers sequence options Atlan shoppers who not too long ago accomplished a complete evaluation of the Lively Metadata Administration market. Passing on what you have discovered to the subsequent information chief is the true spirit of the Atlan neighborhood! That is why they’re right here to share their hard-earned insights into an evolving market, what makes up your fashionable information stack, progressive use instances for metadata, and extra.
On this installment of the sequence, we meet Cristina Pérez Martínez, information engineer and architect, and Ezequiel Barbero, director of enterprise and market intelligence at Telefónica Tech, who share how a contemporary information cataloging expertise and a lineage on the degree of columns will help a broad imaginative and prescient of knowledge democratization.
This interview has been edited for brevity and readability.
Might you inform us just a little about your self, your background and what attracted you to Information & Analytics?
Ezequiel Barbero:
I’ve a Grasp’s diploma in Massive Information and have been working in Information & Analytics since 2002. I began at Telefónica in Argentina with the BI Information staff engaged on SQL-based ETLs. Then I labored in Information Engineering serving to with Information Science, working with the pinnacle of that staff in Argentina.
In 2019 I got here to Spain to work with their Information Science staff in Advertising and marketing Intelligence, and in 2021 I joined Telefónica Tech to start out the BI staff.
Cristina Pérez Martínez:
I began working at Telefónica in 2019 as a Python developer and moved to Telefónica Tech in 2021. My staff has been working primarily as Information Engineers and Information Architects for the BI staff.
Would you care to explain Telefónica and the way its information staff helps the group?
Christina:
Telefónica is split into fairly a couple of completely different firms, however as an entire it’s a Telecommunications Firm. Right here, at Telefónica Tech, the digital enterprise unit, we’ve got centered on digital applied sciences equivalent to AI & BD, connectivity and IoT, Cybersecurity, Cloud and Blockchain.
Our staff is cut up in two, with a part of the staff centered on structure and engineering, getting uncooked information, then standardizing and reworking it till it enters Snowflake, our Information Warehouse. The remainder of the staff is targeted on Information Evaluation, based mostly on Snowflake and coding in SQL. From there, they develop dashboards in PowerBI.
Ezekiel:
Telefónica Tech has a staff engaged on IoT and Massive Information for exterior use instances, however our staff is answerable for inside use instances, supporting the corporate. We help infrastructure, transformation and for nearly a yr the Information Authorities.
What’s your information stack like?
Ezekiel:
Our stack relies on Microsoft Azure and we use Information Manufacturing unit for orchestration. We use Databricks ETL software, blob storage and information lake. Snowflake is Telefónica’s information warehouse.
Why search for an Lively Metadata Administration resolution? What was lacking?
Ezekiel:
Our firm has greater than 6,200 folks, however our staff is small in comparison with the complete group. So, if it is very important enhance the democratization of knowledge, that will not be potential with out self-service and with out Information Governance.
Why was Atlan an excellent match? Did something stand out throughout your analysis course of?
Ezekiel:
We have been first in search of a cloud-based SaaS resolution that was straightforward to deploy and configure.
Christina:
Our objective was to have a spot the place we might create a catalog of knowledge that was accessible sufficient to the remainder of the corporate. It was additionally necessary to grasp the lineage between Snowflake and PowerBI. Our main objective was to grasp the influence that modifying a supply would have on our information warehouse, so column-level lineage ensures end-to-end visibility and traceability. Moreover, we acknowledge the necessity for a sturdy software to strengthen the safety of our information platform, permitting us to assign roles and permissions to make sure that solely licensed folks have entry to particular data, in addition to the flexibility to carry out audits, which is important for keep the integrity and compliance of our information operations.
What do you propose to create with Atlan? Do you might have an concept of the use instances you’ll create and the worth you’ll generate?
Christina:
One of many necessities we had is to create some kind of market for our information, with every thing based mostly on Atlan belongings, and we’re engaged on launching that early this yr. From there, we hope to have the ability to fill in much more metadata in Atlan and Snowflake.
Sooner or later, we’re enthusiastic about the opportunity of utilizing Atlan AI. Our objective is to make it even simpler for folks to entry information, and with the ability to speak to Atlan concerning the information would make it simpler for folks to search out what they want.
Photograph by mario caruso in unpack
