(cherry picked from commit b6265d39)

YARN-3974. Refactor the reservation system test cases to use parameterized base test. (subru via curino)

(cherry picked from commit 8572a5a1)

Revert "HDFS-8499. Refactor BlockInfo class hierarchy with static helper class. Contributed by Zhe Zhang."

This reverts commit c17439c2.

(cherry picked from commit f4c523b6)

Revert "HDFS-8623. Refactor NameNode handling of invalid, corrupt, and under-recovery blocks. Contributed by Zhe Zhang."

This reverts commit de480d6c.

(cherry picked from commit 663eba0a)

(cherry picked from commit cfee02b3)

YARN-3961. Expose pending, running and reserved containers of a queue in REST api and yarn top (adhoot via asuresh)

(cherry picked from commit 154c9d2e)

HDFS-8815. DFS getStoragePolicy implementation using single RPC call (Contributed by Surendra Singh Lilhore)

(cherry picked from commit cc71ad80)

YARN-3992. TestApplicationPriority.testApplicationPriorityAllocation fails intermittently. (Contributed by Sunil G)

(cherry picked from commit df9e7280)

(cherry picked from commit f59612ed)

HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth.

(cherry picked from commit 3da0beda)

YARN-3983. Refactored CapacityScheduleri#FiCaSchedulerApp to easier extend container allocation logic. Contributed by Wangda Tan
(cherry picked from commit ba2313d6)

YARN-3736. Add RMStateStore apis to store and load accepted reservations for failover (adhoot via asuresh)

(cherry picked from commit f271d377)

HADOOP-12302. Fix native compilation on Windows after HADOOP-7824 (Vinayakumar B via Colin P. McCabe)

(cherry picked from commit 4ab49a43)

HADOOP-12280. Skip unit tests based on maven profile rather than NativeCodeLoader.isNativeCodeLoaded (Masatake Iwasaki via Colin P. McCabe)

(cherry picked from commit 6f83274a)

(cherry picked from commit 52f35255)

(cherry picked from commit d5403747)

(cherry picked from commit c95993cb)

HDFS-8850. VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks. (Colin Patrick McCabe via yliu)

docker container exits with non-0 exit status. Contributed by Varun
Vasudev

(cherry picked from commit c3364ca8)

Application is AM managed or not. Contributed by Rohith Sharma K S

(cherry picked from commit 0306d902)

(cherry picked from commit 469cfcd6)

YARN-3978. Configurably turn off the saving of container info in Generic AHS (Eric Payne via jeagles)

(cherry picked from commit 3cd02b95)

HDFS-8847. change TestHDFSContractAppend to not override testRenameFileBeingAppended method. Contributed by Zhihai Xu

(cherry picked from commit 90b51040)

HADOOP-12268. AbstractContractAppendTest#testRenameFileBeingAppended misses rename operation. Contributed by Zhihai Xu

(cherry picked from commit a628a6f1)

(cherry picked from commit d311a38a)

HADOOP-12183. Annotate the HTrace span created by FsShell with the command-line arguments passed by the user (Masatake Iwasaki via Colin P.  McCabe)

(cherry picked from commit 454da959)

HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values (Martin Walsh via Colin P. McCabe)

(cherry picked from commit 21d10ccc)

(cherry picked from commit d0e0ba80)

YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected. Contributed by Bibin A Chundatt
(cherry picked from commit 32e490b6)

(cherry picked from commit 93d50b78)

YARN-433. When RM is catching up with node updates then it should not expire acquired containers. Contributed by Xuan Gong

(cherry picked from commit ab80e277)

(cherry picked from commit 2087eaf6)

HDFS-8821. Explain message "Operation category X is not supported in state standby". Contributed by Gautam Gopalakrishnan.

(cherry picked from commit c5caa25b)

HDFS-7192. DN should ignore lazyPersist hint if the writer is not local. (Contributed by Arpit Agarwal)

YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (Bibin A Chundatt via wangda)

(cherry picked from commit 91b42e7d)

(cherry picked from commit 8acb30b0)

YARN-3919. NPEs' while stopping service after exception during CommonNodeLabelsManager#start. (varun saxena via rohithsharmaks)