Alluxio HA failed to write to the file

Alluxio HA environment, happened today, the user can not write files. Creating folders is normal. But at the end of the copyFromLocal file, there is no response. Finally, you can see the newly created file. But file size is 0.

alluxio fs copyFromLocal test.txt /user/mytest/prefix2

Finally decided to restart the master to see the results. And then I'm going to go back to my room. There is no such thing. Master is not up!!

1. Check master.log and find the problem. At first, it is a normal application log file. In inodeId 52, it cannot be opened normally. The master failed to start.

2018-07-25 16:39:12,897 INFO logger.type (JournalTailer.java:processNextJournalLogFiles) - FileSystemMaster: Processing a completed log file........ 2018-07-25 16:39:21,461 INFO logger.type (JournalReader.java:getNextInputStream) - Opening journal log file: hdfs://azbeta/user/alluxio/journal/FileSystemMaster/completed/log.000000000000000000072018-07-25 16:39:21,512 INFO logger.type (JournalTailer.java:processNextJournalLogFiles) - FileSystemMaster: Processing a completed log file.2018-07-25 16:39:21,520 ERROR logger.type (ServerUtils.java:run) - Uncaught exception while running Alluxio master, stopping it and exiting.java.lang.RuntimeException: alluxio.exception.FileDoesNotExistException: inodeId 52 does not existat alluxio.master.file.FileSystemMaster.processJournalEntry(FileSystemMaster.java:347)at alluxio.master.journal.JournalTailer.processNextJournalLogFiles(JournalTailer.java:123)at alluxio.master.AbstractMaster.start(AbstractMaster.java:148)at alluxio.master.file.FileSystemMaster.start(FileSystemMaster.java:419)at alluxio.master.DefaultAlluxioMaster.startMasters(DefaultAlluxioMaster.java:263)at alluxio.master.FaultTolerantAlluxioMaster.start(FaultTolerantAlluxioMaster.java:91)at alluxio.ServerUtils.run(ServerUtils.java:38)at alluxio.master.AlluxioMaster.main(AlluxioMaster.java:43)>>>>>>>>>>>>>>>Caused by: alluxio.exception.FileDoesNotExistException: inodeId 52 does not exist