Copyright © 2020 fme AG. All Rights Reserved.

fme AG believes the information in this publication is accurate as of its publication date. The information is subject to change without notice.

THE INFORMATION IN THIS PUBLICATION IS PROVIDED "AS IS." FME AG MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.

Use, copying, and distribution of any fme AG software described in this publication requires an applicable software license.

All trademarks used herein are the property of their respective owners.

This online documentation describes how to use the migration-center software in order to migrate content from a source system into a target system (or into the same system in case of an in-place migration).

Please see the Release Notes for a summary of new and changed features as well as known issues in the migration-center releases.

Also, please make sure that you have read System Requirements before you install and use migration-center in order to achieve the best performance and results for your migration projects.

The supported source and target systems and their versions can be found in our knowledge base article List of supported versions.

The migration-center is a modular system that uses so called adapters in order to connect to the various source and target systems. The adapters to connect to a source system are called scanners and the adapters to connect to a target system are called importers. The capabilities and the configuration parameters of each adapter are described in the corresponding manual.

You can find the explanations of the terms and concepts used in this manual in the Glossary.

And last but not least, Legal Notice contains some important legal information.

Further Resources

For additional tips and tricks, latest blog posts, FAQs, and helpful how-to articles, please visit our user forum.

In case you have technical questions or suggestions for improving migration-center, please send an email to our product support at support@migration-center.com.

Migration Set A migration set comprises a selection of objects (documents, folders) and set of rules for migrating these objects. A migration set represents the work unit of migration-center. Objects can be added or excluded based on various filtering criteria. Individual transformation rules, mapping lists and validations can be defined for a migration set. Transformation rules generate values for attributes, which are in turn validated by validation rules. Objects failing to pass either transformation or validation rules will be reported as errors, requiring the user to review and fix these errors before being allowed to import such objects.

Attribute A piece of metadata belonging to an object (e.g. name, author, creation date, etc.). Can also refer to the attribute’s value, depending on context.

Transformation Rules A set of rules used for editing, transforming and generating attribute values. A set of transformation rules is always unique to a migration set. A single transformation rules is comprised of one or several different steps, where each step calls exactly one transformation function. Transformation rules can be exported/imported to/from files or copied between migration sets containing the same type of objects.

Transformation Function Transformation functions compute attribute values for a transformation rule. Multiple transformation functions can be used in a single transformation rule.

Job Server The migration-center component listening to incoming job requests, and running jobs by executing the code behind the adapters referred by those jobs. Starting a scanner or importer which uses the Documentum adapter will send a request to the Jobserver set for that scanner, and tell that Jobserver to execute the specified job with its parameters and the corresponding adapter code.

Transformation The transformation process transforms a set of objects according to the set of rules to generate or extract.

Validation Validation checks the attribute values resulting from the Transformation step against the definitions of the object types these attributes are associated with. It checks to make sure the values meet basic properties such as data type, length, repeating or mandatory properties of the attributes they are associated with. Only if an object passes validation for every one of its attributes will it be allowed for import. Objects which do not pass validation are not permitted for import since they would fail anyway.

Mapping list A mapping list is a key-value pair used to match a value from the source data (the key) directly to the specified value.

migration-center 3.17 Update 4

This release contains the following fixes and updates:

• Updated spring libraries for potential vulnerability CVE-2022-22965 (#61574)

• Fixed error when setting user attributes to "Guest" user using the SharePoint Online Batch Importer (#60948)

Remember to reinstall the CSOM service as well for the SharePoint Online Batch Importer as described here.

AIP - Archival Information Package

AIU - Archival Information Unit

BLOB - Binary large object

DB - Database

CSV - Comma separated values

CLOB - Character large object

DCTM - Documentum

DFC - Documentum Foundation Classes

DMS - Document Management System

DSS - Data Submission Session

GB - Gigabyte

GHz - Gigahertz

IA - InfoArchive

JDBC - Java database connectivity

JRE - Java Runtime Environment

JVM - Java Virtual Machine

KB - Kilobyte

MB - Megabyte

MS - Microsoft

MHz - Megahertz

RAM - Random Access Memory

regex - Regular expression

SIP - Submission Information Package

SPx - Service Pack x

SQL - Structured Query Language

XML - Extensible Markup Language

XSD - File that contains a XML Schema Definition

XSL - File that contains Extensible Stylesheet Language Transformation rules

A content migration with migration-center always involves a source system, a target system, and of course the migration-center itself.

This section provides information about the requirements for using migration-center in a content migration project.

For best results and performance it is recommended that every component will be installed on a different system. Hence, the system requirements for each component are listed separately.

The required capacities depend on the number of documents to be processed. The values given below are minimal requirements for a system processing about 1.000.000 documents. Please see the Sizing Guide for more details.

Database Server

Server Components (Job Server)

Client

migration-center 3.17 Update 3

This release is a collection of cumulative fixes that have been done since version 3.17 Update 2.

Fixes

• Veeva Importer:

  • Importing submission to Veeva RIM with skipUploadContent throws error but import is successful (#60418)

  • Importing submission with skipUploadContent checked does not work (#60306)

  • Uploading/Downloading content to/from FTP Staging Folder does not work with REST calls (#60493)

  • Setting object_type__v attribute throws NullPointerException (#60659)

  • Updating objects throws an error (#60571)

  • The version tree is not correctly scanned when the minor version is greater than 9 (#60957)

  • Submission response is not parsed correctly (#60780)

• Veeva Scanner:

  • Veeva scanner continue working on background after stop (#60805)

• SharePoint Online Scanner:

  • Scanning objects throws an error when parsing the creation date (#60751)

  • An SQL Exception is thrown when the attribute value is greater than the limit (#60208)

  • The build sometimes is compiled for 32 bit platform (#60211)

  • The total number of objects displayed in summary is not correct (#60205)

• D2 Importer:

  • NullPointerException when importing VD relation updates (#60470)

• Dctm Importer (NCC)

  • Updating content on Documnetum NCC with ECS does not work properly (#60795)

migration-center 3.17 Update 2

Features & Enhancements

• Generis Cara Importer:

  • Add support for importing relations (#59664)

  • Add support for setting rendition identifier(#60027)

Known Issues & Limitations

• Generis Cara Importer:

  • When binding relations by version label, no error is thrown when incorrect or missing version label mapping is provided(#60093)

  • Importing a base document and one update (as result of delta scan) results in unpredictable behavior(#60118)

migration-center 3.17 Update 1

Features & Enhancements

• Veeva Importer:

  • Multi-threading for upload content process (#59158)

  • Upload content using File Staging REST API (#59680)

  • Added object type order when importing Veeva Objects (#59085)

  • Updated to use API 21.2 (#59343)

• Veeva Scanner:

  • Multi-threading for download content process (#59158)

  • Retrieving inactive dictionary value from Veeva (#59516)

  • Scan new audit trails in Delta scan (#59641)

  • Download the content from FTP by using REST API (#59160)

  • Updated to use API 21.2 (#59684)

Fixes

• General:

  • Removed SQLJUTL package dependency which caused errors on certain Oracle DBs (#59700)

• SharePoint Online Importer:

  • Removed the need for having minor versions enabled when importing folder updates (#59570)

Known Issues & Limitations

• InfoArchvie Importer:

  • Using Java 8 when generating large PDI files may result in incorrect values in the PDI file (#59214)

• Veeva Importer:

  • objectsOrder feature is ignored if it does not contain all object_name values from the migset (#59981)

  • Setting object_name values that don't exist in Veeva in objectOrder does not throw error (#59980)

migration-center 3.17

Features & Enhancements

• General:

  • Transformation function getDataFromSql can return multiple values (#535420)

• Hyland OnBase Importer

  • Import documents

  • Set custom metadata

  • Import document revisions

  • Delta migration (only for metadata)

• Amazon Comprehend Enrich Scanner

  • Enrich documents metadata based on the content

  • Language detection

  • Extract entities (standard and custom)

  • Support custom classifiers

• Filesystem Scanner:

  • Make versioning case insensitive (#58656)

• Documentum Scanner:

  • Allow more flexible queries for selecting documents to be scanned (#58345)

  • Create counter for already scanned objects in the execution summary (#58907)

  • Export documents with content_location pointing to the path in the storage (#54317)

• Cara Importer:

  • Import audit trails from Documentum as audit trails objects (#58797)

  • Index the imported documents (#59513)

Fixes

• General:

  • Scheduler next run date not calculated correctly (#58845)

• Cara Importer:

  • Fix reporting errors for missing/incorrect system attributes (#58488)

  • Fix nonintuitive error message when required content or rendition attributes are not set (#58608)

• CSV-Excel Scanner:

  • Fix scanning CSV with UTF8 - BOM with first column used as ID (#54010)

• Veeva Importer:

  • Fix max length for system rules (#59046)

  • Attributes mapping does not work properly when the object_type__v is not the same as the object that is imported (#57383)

• Veeva Scanner:

  • Binder relations are scanned even if the child documents are not (#56230)

• SharePoint Online Importer:

  • Temp file is deleted early if HTML error is thrown (#58869)

• OpenText Content Server Importer:

  • Importing compound documents doesn't fail when folder with same name already exists (#52038)

• D2 Importer:

  • Repeating default values are not set correctly (#58692)

Known Issues & Limitations

• Cara Importer:

  • Asynchronous Indexing not setting index on documents (#59574)

• SharePoint Online Scanner:

  • CAML query not working on SPO Scanner (#59597)

migration-center 3.16

Features & Enhancements

• General

  • Add support for Java 11 for all adapters (#53313)

  • Add new transformation function: GetInternalAttributeValue (#57376)

  • Add new transformation function: CalculateNewNumber (#58237)

• Cara Importer (NEW)

  • Add support for checksum verification (#57744)

  • Add support for importing VDs (#57756)

  • Add support for proxy communication (#58057)

  • Add support for uploading content using REST (#58169)

• D2 InPlace Adapter (NEW)

  • D2 Auto-Naming functionality (#57662)

  • D2 Auto-Linking functionality (#57663)

  • D2 Auto-Security functionality (#57664)

  • Validate attributes values based on D2 dictionaries (#57666)

  • Apply D2 rules based on a document’s owner (#57667)

• CSV/Excel Scanner

  • Add support for delta migration on CSV/Excel scanner (#56911)

• D2 Importer

  • Add support for D2 20.4 (#55909)

• Database Scanner

  • Improve performance when scanning data from a single query (#56714)

• Documentum Importer/Scanner

  • Add support for DCTM server 20.4 (#55904)

• Filesystem Scanner

  • Add support for scanning paths provided in a text file (#57073)

  • Specify folders to exclude as relative paths (#57074)

  • Enhance explicit versioning to new versions to existing ones during delta scan(#58563)

• InfoArchive Importer

  • Add support for InfoArchive 20.4 (#55912)

  • Add support for generating huge PDI files (#56912)

• Opentext Content Server Scanner/Importer

  • Add support for OpenText Content Server 20.4 (#55901)

• SharePoint Online Batch Importer

  • Set retention policy labels (#56114)

  • Set sensitivity labels (#57086)

  • Add support for QuickXorHash (needed for files > 15 GB) (#57226)

Fixes

• CSV/Excel Scanner

  • Cells that have nothing but are scanned as null (#57228)

• Documentum Importer

  • Repeating attributes are not rewritten on new versions (#58231)

• Opentext Content Server Importer

  • The job status is not properly set when occurring OutOfMemory error (#57022)

• SharePoint Online Batch Importer

  • MIP Service fails to load DLL (#58038)

• Veeva Scanner

  • The temporary location is not cleared up after the scan run (#57853)

• Veeva Importer

  • Validation errors are not cleared after each validated document (#57206)

  • Submissions cannot be imported when having more than 200 applications (#58062)

Known Issues & Limitations

• Veeva Scanner

  • The binder relations are scanned even if the children documents are not (#56230)

• SharePoint Online Batch Importer

  • When trying to import a broken version tree, the import fails for all documents (even the ones that had a correct version tree) with an error status (#57099)

• Database Scanner

  • The summary is not completely accurate when using a single query (#58228)

• InfoArchive Importer

  • The first version of child doc remains validated when includeChildrenVersions is set to false and includeChildrenOnce is set to true (#57766)

• Veeva Importer

  • Attributes mapping does not work properly when the object_type__v is not the same as the object that is imported (#57383)

• Opentext Content Server Importer

  • NPE when importing documents with no content (#58288)

migration-center 3.15 Update 2

Features & Enhancements

• General

  • Migrate OT shortcuts and URLs to SPO link documents (#55974)

  • New TrackWise Digital importer available (#53977)

  • Improve the performance of the mapping list transformations (#56913)

• SharePoint Online Batch Importer

  • Improve robustness of verification step (#55898)

  • Allow import into multiple sites (#56043)

  • Save imported object URL in object_info1 column (#56113)

• SharePoint Online Scanner

  • App-Only authentication in SPO scanner (#54259)

• Veeva Scanner

  • Automatic resume after daily API limit was exceeded (#56898)

Fixes

• File System Scanner

  • content_location and mc_content_location not updated when using moveFilesToFolder (#56471)

  • Metadata files are not moved when moveFileToFolder is checked (#56488)

• SharePoint Online Classic Importer

  • 'null' added to path when importing to root folder (#56603)

  • Move folder not working in SPO importer (#56703)

• Veeva Importer

  • Document with auto-generated name __v cannot be imported (#56684)

  • Error when importing doc with empty string in attachments and skipUploadToFTP (#56826)

• Veeva Scanner

  • The rendition for already scanned objects is exported to disk in some cases (#56283)

  • Proxy configuration ignored for HTTP requests (#56566)

  • Running scanners in parallel fails with error (#56763)

Known Issues & Limitations

• Veeva Scanner

  • The binder relations are scanned even if the children documents are not (#56230)

• InfoArchive Importer

  • OutOfMemory exception might be thrown by InforArchive importer when generating very large SIP file (#55698)

• SharePoint Online Batch Importer

  • When trying to import a broken version tree, the import fails for all documents (even the ones that had a correct version tree) with an error status (#57099)

• SharePoint On-Prem Importer

  • Moving folders fails with 'File not found' error (#57111)

migration-center 3.15 Update 1

Features & Enhancements

• General

  • Add Veeva Scanner that exports documents and binders from Veeva Vault (#54569)

  • Migrate OpenText shortcuts and URLs to SPO link documents (#55974)

• Documentum Scanner

  • Export all folder paths of all folders where a document is linked (#55486)

• OpenText Scanner

  • Add the URL/path of the original object to the scanned shortcut (#56206)

  • Allow users to configure a list of workspaces/root nodes to be scanned (#55899)

  • Scan URLs as OpenText(object) type so they can be imported to other systems (ex: SharePoint Online) (#56001)

• SharePoint Online Importer

  • Add support for setting sensitivity label for importing documents (#55645)

• Veeva Importer

  • Enable Migration Mode programmatically for the imported objects so Migration Mode is not necessary to be enabled on the vault level (#55493)

Fixes

• Veeva Importer

  • Duplicate values are not supported for object_type__v attribute in RIM Vault (#55664)

Known Issues & Limitations

• Veeva Scanner

  • The renditions for already scanned objects is exported to disk in some cases (#56283)

  • The binder relations are scanned even if the children documents are not (#56230)

• InfoArchive Importer

  • OutOfMemory exception might be thrown by InforArchive importer when generating very large SIP file (#55698)

migration-center 3.15

Features & Enhancements

• CSV - Excel Scanner:

  • Added support for scanning repeating attributes (#54993)

• InfoArchive Importer:

  • Added support for multiple references to the same content (#55529)

• OTCS Scanner:

  • Added support for scanning CAD documents as regular documents (#55900)

• SharePoint Online Batch Importer:

  • Added support for setting approval status on documents (#54990)

  • Added support for setting version numbering (#55505)

  • Added support for setting Lookup field type (#55521)

• Veeva Importer:

  • Added support for delta migration of Veeva objects (#54928)

  • Added support for importing attachments for Veeva Objects (#55535)

• Core Database:

  • Added additional multi-value transformation functions (#55424)

Fixes

• OTCS Importer:

  • Fixed record date not being set in opentext_rm_classification (#55431)

• SharePoint Online Batch Importer:

  • Fixed import failing with invalid XML characters in attributes (#55007)

  • Fixed import failing verification (#55574)

  • Fixed import failing into library with deep path (#55745)

• SharePoint Online Importer:

  • Fixed import failing into site collection URL with spaces (#55571)

  • Fixed not being able to assign AD group (#55796)

  • Fixed error on folder update (#55870)