Data loading
The data is ready to be loaded into its new warehouse. Just be sure that, in addition to the
syntax rules that we have validated, your data meets other requirements that some
databases include.
Uwazi, the free open-source software developed by HURIDOCS for organising, analysing
and publishing information, has specific requirements on how to do this process. These
requirements include guidelines about how to name and upload files, allowed formats,
matching field names, etc.
If your dataset is in compliance with all the requirements, you can load it to the target
system.
3. After the migration
Once the data is migrated, it is still required to verify if everything went well. In that case,
we will be ready to shut down the legacy system. If something went really wrong, we will
still have the option to restore our backup.
The reconciliation test compares the data in the target database against the original
source, including aspects such as quantity (checking for missing records and values, or
duplicate records), data profiling metrics, structure (relationships established between
fields or tables in the old and the new databases), etc. You can do this process manually
(with the data profiling and data validation techniques that we have shown previously), or
with the functionalities included in software specifically dedicated to data migration.
After the verification and a reasonable period of time, we can wipe out the source database
and the migration process will be completed.
17