BEFORE you begin importing files or data, read the section at the bottom of this article.
Import tools make it easy to transfer your assets and metadata into NetX.
- Have you finished gathering your files?
- Do you have associated metadata that needs to be transferred?
- Who is responsible for preparing files and metadata for import?
- Which upload tool will you use for your initial import?
5 things to know about an initial ingest of files and data
Best practices
Plan ahead.
Assign sufficient resources to prepare and deliver files and data. Migration preparation often takes a lot longer than you imagine. Prioritize popular assets and consider breaking up large or complex import projects into smaller batches.
Let it go.
Take the opportunity to filter out unnecessary files for a clean start in NetX. In many cases, storing only the highest resolution versions is sufficient as derivatives can be created on-demand instead of being stored. Plan carefully whether or not to store raw materials in NetX, such as unretouched photos or unedited HD video. NetX should store files that are of value to your organization, so resist storing everything!
Filenames are your friends.
Filenames are indexed by the search engine — take advantage of this fact. Descriptive, intuitive, consistent, and concise filename conventions are best. Avoid illegal characters and excessively long filenames (technical limit is 255 characters, best practice is less than 25 characters). Case and spelling matter — image.JPG, image.jpg, and image.jpeg are treated as distinct files in NetX. Unique filenames prevent collisions when adding assets to folders or uploading metadata via .csv.
Cataloging is better in bulk.
Attribute values can easily be applied to batches of assets at the time of import using the browser upload tool or the NetX I/O app.
Import your way.
Manage your own file and data ingest via the browser uploader and .csv import tools or engage our professional services team to handle things for you.
How-to articles
- File Ingest Policy has all the details you need to know.
- Avoid Illegal Characters in Asset and Folder Names.
- Check Supported File Formats for info on thumbnails, previews, and format conversions.
- Uploading Assets can be done directly from your browser. A good option for smaller groups of assets or ad-hoc file organization.
- NetX I/O is a desktop application convenient for self-managed ingests.
- SaaS customers can ship a hard drive—read the guidelines on Hard Drive Requirements for important information on hardware, formatting, security, and shipping.
- To migrate existing metadata via spreadsheet, check out Uploading Attribute Data.
- Read about Excel and CSV Encoding before preparing your data file.
- Sync embedded metadata to NetX attributes on import with the Metadata Maps feature.
- Editing Metadata Overview has details on all the cataloging features in NetX.
Tips and tricks
Login as a generic "system" Admin user instead of your own user account to avoid accidental import interruptions. Using a generic user (such as netx_admin or import_admin) can be helpful for statistics and to distinguish files in the initial import from subsequent imports.
For initial ingests via NetX I/O or a shipped hard drive, subfolders will be automatically created during the ingest. Only the top-level structure needs to be created ahead of time in NetX.
For initial ingests via the browser, all subfolders need to be created before uploading files.
To increase indexing efficiency, all folder permissions should be configured prior to your initial import. Add all folders and sub-folders to which permissions apply, create user groups, then configure permissions.
If a filename collision occurs, subsequent assets will be appended -1, -2, etc. which may impact data imports or other workflows dependent on accurate filenames. See the section on duplicate filenames in the Uploading Assets article for details.
Duplicate Asset Detection can be configured if you have a large number of duplicate assets that need to be weeded out. See point 5 in the section below if you wish to use this feature.
*BEFORE YOU IMPORT ASSETS OR METADATA*
1. Review our File Ingest Policy.
2. Provide these details to your Onboarding Specialist (estimates are fine):
- total size in GB/TB of the import
- total number of files
- average file size
- percentage of each file type
- (e.g. 50% images, 40% video, 10% multi-page documents)
3. Ensure the following essential configurations are in place:
- all top-level folders
- any subfolders that have permissions
- user groups
- permissions
- all properties that alter how files or data are processed
- properties to optimize an initial ingest
4. If your site uses any optional configurations, these should be in place prior to import, along with all associated attribute fields, vocabularies, folders, and permissions:
- attribute profiles
- embedded metadata mappings triggered on import
- autotask workflows triggered on import
- autotasks that generate views or derivatives
- indexing document content for basic keyword search
- embedded color profiles for proxies
- advanced configurations such as:
- .jar files for custom jobs
- MediaRich Zooms
- InDesign Server
- Hydra configuration
- any other configurations that are impacted by the import of files or data
5. If you're using Duplicate Asset Detection:
- turn on MD5 Checksums prior to the initial ingest, but DO NOT turn on the LinkDuplicatesJob. This ensures the asset count in NetX can be verified against the original ingest manifest.
- once the ingest completes and has been verified, export the following attributes for all assets: Asset Id, File, Folder Path, Checksum. Review these files before proceeding with Duplicate Asset Detection. Identify duplicate checksums using Excel and then Upload Selection to NetX
- turn on the LinkDuplicatesJob and then initiate an index-only resync on the Selection to remove any duplicates (see Resyncing Assets).
- filenames are ignored by this system, so identical files with different filenames will still be detected as duplicates. Conversely, non-identical files with the same filenames will not be caught by Duplicate Asset Detection.