Note: This is an old post from notes. This may not be applicable anymore but sharing in case it helps someone.

Overview

Apache Storm after HDP 2.2 seems to have a hard time with large topology jars and takes a while to upload them. There have been a few reports of Storm topology jars uploading slowly. I ran into this a few years ago. The fix is to increase the nimbus.thrift.max_buffer_size setting.

Fix

Increase nimbus.thrift.max_buffer_size from the default of 1048576 to 20485760.

References