java.nio.channels.ClosedChannelException

ERROR client.TransportClient: Failed to send RPC RPC 7651764253676103503 to /10.169.12.139:45996: java.nio.channels.ClosedChannelException

原因：给节点分配的内存少，yarn kill了spark application

解决：配置yarn-site.xml

<property> <name>yarn.nodemanager.pmem-check-enabled</name> <value>false</value> </property> <property> <name>yarn.nodemanager.vmem-check-enabled</name> <value>false</value> </property>

参考：https://blog.csdn.net/u012957549/article/details/89361485