Frequently Asked Questions
What does the Bacula Enterprise HDFS plugin back up?
The plugin protects files stored in the Hadoop Distributed File System, such as data lake files, application exports and research datasets. Plan separate protection for Hadoop service configurations, external metastores and other components that your applications need to run.
Why back up Hadoop if HDFS already replicates data?
HDFS replication keeps data available when storage nodes fail. When Bacula stores a backup outside the production cluster, that copy can support recovery if the cluster and its snapshots are lost. Bacula uses HDFS snapshots as the point-in-time source for its backups.
What do I need to run the HDFS backup plugin?
Install the plugin on a Bacula Enterprise File Daemon host with Java 8 or later and network access to the HDFS cluster. Enable snapshots on the HDFS base directory selected for each backup job and give the backup identity the required permissions. For Kerberos, configure the relevant principals and keytab on the File Daemon host.
How do incremental and differential HDFS backups work?
Bacula creates a snapshot of the configured directory and compares it with a prior Bacula snapshot to identify changes. If that snapshot is unavailable, the job scans the full current snapshot. Keep the snapshots required by your backup schedule and manage Bacula backup retention separately.
Can I restore an individual HDFS file or recover it outside Hadoop?
Yes. Select the files you need and restore them to their original HDFS location, another directory in HDFS, or a local path on the File Daemon host.
Does the HDFS plugin preserve ACLs and extended attributes?
The current plugin does not capture HDFS access control lists (ACLs), extended attributes, file creation times, empty directories or directory attributes. If your recovery plan depends on any of these, document how you will recreate them and verify the process in a restore test.
Is the HDFS plugin available in Bacula Community?
The HDFS plugin is available with Bacula Enterprise. Share your Hadoop distribution, HDFS version and restore requirements with Bacula Systems to discuss compatibility and evaluation options.