[KAFKA-4392] Failed to lock the state directory due to an unexpected exception - ASF JIRA

[KAFKA-4392] Failed to lock the state directory due to an unexpected exception - ASF JIRA

This happened on streaming startup, on a clean installation, no existing folder. Here I was starting 4 instances of our streaming app on 4 machines and one threw this exception. Seems to me there's a race condition somewhere when instances discover others, or something like that.

2016-11-02 15:43:47 INFO StreamRunner:59 - Started http server successfully.
2016-11-02 15:44:50 ERROR StateDirectory:147 - Failed to lock the state directory due to an unexpected exception
java.nio.file.NoSuchFileException: /data/1/kafka-streams/myapp-streams/7_21/.lock
at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
at sun.nio.fs.UnixFileSystemProvider.newFileChannel(UnixFileSystemProvider.java:177)
at java.nio.channels.FileChannel.open(FileChannel.java:287)
at java.nio.channels.FileChannel.open(FileChannel.java:335)
at org.apache.kafka.streams.processor.internals.StateDirectory.getOrCreateFileChannel(StateDirectory.java:176)
at org.apache.kafka.streams.processor.internals.StateDirectory.lock(StateDirectory.java:90)
at org.apache.kafka.streams.processor.internals.StateDirectory.cleanRemovedTasks(StateDirectory.java:140)
at org.apache.kafka.streams.processor.internals.StreamThread.maybeClean(StreamThread.java:552)
at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:459)
at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:242)

Read full article from [KAFKA-4392] Failed to lock the state directory due to an unexpected exception - ASF JIRA