Posts - Datamillennium

Cataloging Unstructured Data for GenAI Projects

By Malcolm Chisholm With the AI race on, there is a great need for data sets to drive AI projects to success. There are many different kinds of data, but today let’s consider unstructured data. As a quick reminder, examples of structured data sources are excel files, database tables, JSON docs, while unstructured data…

Data Literacy Is a Requirement for Generative AI Solutions

By Malcolm Chisholm As Generative AI (GenAI) gets more and more popular, it is crucial for enterprises to begin to properly grasp true GenAI capabilities – especially as the hype and hopes around the technology grows. The LLM solutions are certainly breathtaking, but they have significant real-world limitations to be aware of. The…

AI and Data Governance

By Malcolm Chisholm With the advent of AI there is a growing realization that many new Data Governance tasks are required. There are, of course, many AI Governance needs, such as what LLM to select, and how to mitigate model risks. But even some of these overlap with Data Governance. For instance, AI models…

CHANGING REFERENCE DATA TABLE NAMES

By Malcolm Chisholm Reference data is often thought of as being slow to change, and in fact is sometimes called “static”. Of course, in the aggregate, reference data changes frequently, which is one of the reasons that Reference Data Management (RDM) exists. When we think of this, it is usually the reference data codes and…

PREPARING FOR REFERENCE DATA CHANGES

By Malcolm Chisholm Normally, we think of changes to reference data as something that is provided and which the Reference Data Management (RDM) function of the enterprise simply pushes into the relevant databases. However, this is not always so. In some cases reference data changes have to be planned, rather than the changes simply applied.…