Форматирование имен в Hadoop 3.2.1 не работает
У меня [похоже] та же проблема с Форматированием имен в Hadoop 3.2.1
По запросу, чтобы задать этот вопрос как новый, а также предоставить более подробную информацию:
Это происходит на рабочем столе, Windows 10, 64-разрядная версия, применены все обновления Windows.
Следовал всем инструкциям в соответствии с https://dev.to/awwsmm/installing-and-running-hadoop-and-spark-on-windows-33kc . За исключением: а) Hadoop 3.2.1 (и после блокировки по этой проблеме, пробовал Hadoop 3.1.0 и Hadoop 2.8.0) б) apache-hadoop-3.1.0-winutils-master.zip для winutils.exe и hadoop.dll исправление (не удалось найти более позднюю версию?) c) В предыдущем тесте использовался C:Hadoophadoop-3.2.1data папки [namenode, datanode], что привело к тому же результату, как показано ниже. Изменение на D:Hadoophadoop-3.2.1data ..(показано ниже) относится к диску D: с большим количеством свободного места.
-
[ИЗ командной строки, запустите от имени администратора], подтвердите, что Java и hdfs доступны
C:WINDOWSsystem32>hdfs -version java version "1.8.0_221" Java(TM) SE Runtime Environment (build 1.8.0_221-b11) Java HotSpot(TM) 64-Bit Server VM (build 25.221-b11, mixed mode) C:WINDOWSsystem32>java -version java version "1.8.0_221" Java(TM) SE Runtime Environment (build 1.8.0_221-b11) Java HotSpot(TM) 64-Bit Server VM (build 25.221-b11, mixed mode)
-
Выполнить
namenode -format C:WINDOWSsystem32>hdfs namenode -format
2019-10-13 12:01:58,470 INFO namenode.NameNode: STARTUP_MSG: C:WINDOWSsystem32>hdfs namenode -format 2019-10-13 12:01:58,470 INFO namenode.NameNode: STARTUP_MSG: /************************************************************ STARTUP_MSG: Starting NameNode STARTUP_MSG: host = DESKTOP-354IRPS/10.0.0.23 STARTUP_MSG: args = [-format] STARTUP_MSG: version = 3.2.1 STARTUP_MSG: classpath = C:Hadoophadoop-3.2.1etchadoop;C:Hadoophadoop-3.2.1sharehadoopcommon;C:Hadoophadoop-3.2.1sharehadoopcommonlibaccessors-smart-1.2.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibanimal-sniffer-annotations-1.17.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibasm-5.0.4.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibaudience-annotations-0.5.0.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibavro-1.7.7.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibchecker-qual-2.5.2.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcommons-beanutils-1.9.3.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcommons-cli-1.2.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcommons-codec-1.11.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcommons-collections-3.2.2.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcommons-compress-1.18.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcommons-configuration2-2.1.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcommons-io-2.5.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcommons-lang3-3.7.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcommons-logging-1.1.3.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcommons-math3-3.1.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcommons-net-3.6.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcommons-text-1.4.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcurator-client-2.13.0.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcurator-framework-2.13.0.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibcurator-recipes-2.13.0.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibdnsjava-2.1.7.jar;C:Hadoophadoop-3.2.1sharehadoopcommonliberror_prone_annotations-2.2.0.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibfailureaccess-1.0.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibgson-2.2.4.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibguava-27.0-jre.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibhadoop-annotations-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibhadoop-auth-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibhtrace-core4-4.1.0-incubating.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibhttpclient-4.5.6.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibhttpcore-4.4.10.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibj2objc-annotations-1.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjackson-annotations-2.9.8.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjackson-core-2.9.8.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjackson-core-asl-1.9.13.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjackson-databind-2.9.8.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjackson-jaxrs-1.9.13.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjackson-mapper-asl-1.9.13.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjackson-xc-1.9.13.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjavax.servlet-api-3.1.0.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjaxb-api-2.2.11.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjaxb-impl-2.2.3-1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjcip-annotations-1.0-1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjersey-core-1.19.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjersey-json-1.19.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjersey-server-1.19.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjersey-servlet-1.19.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjettison-1.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjetty-http-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjetty-io-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjetty-security-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjetty-server-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjetty-servlet-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjetty-util-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjetty-webapp-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjetty-xml-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjsch-0.1.54.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjson-smart-2.3.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjsp-api-2.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjsr305-3.0.0.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjsr311-api-1.1.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibjul-to-slf4j-1.7.25.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerb-admin-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerb-client-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerb-common-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerb-core-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerb-crypto-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerb-identity-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerb-server-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerb-simplekdc-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerb-util-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerby-asn1-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerby-config-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerby-pkix-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerby-util-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibkerby-xdr-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonliblistenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar;C:Hadoophadoop-3.2.1sharehadoopcommonliblog4j-1.2.17.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibmetrics-core-3.2.4.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibnetty-3.10.5.Final.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibnimbus-jose-jwt-4.41.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibparanamer-2.3.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibprotobuf-java-2.5.0.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibre2j-1.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibslf4j-api-1.7.25.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibslf4j-log4j12-1.7.25.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibsnappy-java-1.0.5.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibstax2-api-3.1.4.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibtoken-provider-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibwoodstox-core-5.0.3.jar;C:Hadoophadoop-3.2.1sharehadoopcommonlibzookeeper-3.4.13.jar;C:Hadoophadoop-3.2.1sharehadoopcommonhadoop-common-3.2.1-tests.jar;C:Hadoophadoop-3.2.1sharehadoopcommonhadoop-common-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonhadoop-kms-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopcommonhadoop-nfs-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfs;C:Hadoophadoop-3.2.1sharehadoophdfslibaccessors-smart-1.2.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibanimal-sniffer-annotations-1.17.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibasm-5.0.4.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibaudience-annotations-0.5.0.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibavro-1.7.7.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibchecker-qual-2.5.2.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-beanutils-1.9.3.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-cli-1.2.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-codec-1.11.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-collections-3.2.2.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-compress-1.18.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-configuration2-2.1.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-daemon-1.0.13.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-io-2.5.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-lang3-3.7.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-logging-1.1.3.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-math3-3.1.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-net-3.6.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcommons-text-1.4.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcurator-client-2.13.0.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcurator-framework-2.13.0.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibcurator-recipes-2.13.0.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibdnsjava-2.1.7.jar;C:Hadoophadoop-3.2.1sharehadoophdfsliberror_prone_annotations-2.2.0.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibfailureaccess-1.0.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibgson-2.2.4.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibguava-27.0-jre.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibhadoop-annotations-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibhadoop-auth-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibhtrace-core4-4.1.0-incubating.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibhttpclient-4.5.6.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibhttpcore-4.4.10.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibj2objc-annotations-1.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjackson-annotations-2.9.8.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjackson-core-2.9.8.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjackson-core-asl-1.9.13.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjackson-databind-2.9.8.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjackson-jaxrs-1.9.13.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjackson-mapper-asl-1.9.13.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjackson-xc-1.9.13.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjavax.servlet-api-3.1.0.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjaxb-api-2.2.11.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjaxb-impl-2.2.3-1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjcip-annotations-1.0-1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjersey-core-1.19.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjersey-json-1.19.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjersey-server-1.19.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjersey-servlet-1.19.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjettison-1.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjetty-http-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjetty-io-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjetty-security-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjetty-server-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjetty-servlet-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjetty-util-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjetty-util-ajax-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjetty-webapp-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjetty-xml-9.3.24.v20180605.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjsch-0.1.54.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjson-simple-1.1.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjson-smart-2.3.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjsr305-3.0.0.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibjsr311-api-1.1.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerb-admin-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerb-client-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerb-common-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerb-core-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerb-crypto-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerb-identity-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerb-server-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerb-simplekdc-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerb-util-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerby-asn1-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerby-config-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerby-pkix-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerby-util-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibkerby-xdr-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibleveldbjni-all-1.8.jar;C:Hadoophadoop-3.2.1sharehadoophdfsliblistenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar;C:Hadoophadoop-3.2.1sharehadoophdfsliblog4j-1.2.17.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibnetty-3.10.5.Final.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibnetty-all-4.0.52.Final.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibnimbus-jose-jwt-4.41.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibokhttp-2.7.5.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibokio-1.6.0.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibparanamer-2.3.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibprotobuf-java-2.5.0.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibre2j-1.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibsnappy-java-1.0.5.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibstax2-api-3.1.4.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibtoken-provider-1.0.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibwoodstox-core-5.0.3.jar;C:Hadoophadoop-3.2.1sharehadoophdfslibzookeeper-3.4.13.jar;C:Hadoophadoop-3.2.1sharehadoophdfshadoop-hdfs-3.2.1-tests.jar;C:Hadoophadoop-3.2.1sharehadoophdfshadoop-hdfs-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfshadoop-hdfs-client-3.2.1-tests.jar;C:Hadoophadoop-3.2.1sharehadoophdfshadoop-hdfs-client-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfshadoop-hdfs-httpfs-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfshadoop-hdfs-native-client-3.2.1-tests.jar;C:Hadoophadoop-3.2.1sharehadoophdfshadoop-hdfs-native-client-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfshadoop-hdfs-nfs-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoophdfshadoop-hdfs-rbf-3.2.1-tests.jar;C:Hadoophadoop-3.2.1sharehadoophdfshadoop-hdfs-rbf-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarn;C:Hadoophadoop-3.2.1sharehadoopyarnlibaopalliance-1.0.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibbcpkix-jdk15on-1.60.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibbcprov-jdk15on-1.60.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibehcache-3.3.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibfst-2.50.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibgeronimo-jcache_1.0_spec-1.0-alpha-1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibguice-4.0.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibguice-servlet-4.0.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibHikariCP-java7-2.4.12.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibjackson-jaxrs-base-2.9.8.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibjackson-jaxrs-json-provider-2.9.8.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibjackson-module-jaxb-annotations-2.9.8.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibjava-util-1.9.0.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibjavax.inject-1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibjersey-client-1.19.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibjersey-guice-1.19.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibjson-io-2.5.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibmetrics-core-3.2.4.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibmssql-jdbc-6.2.1.jre7.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibobjenesis-1.0.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibsnakeyaml-1.16.jar;C:Hadoophadoop-3.2.1sharehadoopyarnlibswagger-annotations-1.5.4.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-api-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-applications-distributedshell-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-applications-unmanaged-am-launcher-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-client-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-common-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-registry-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-server-applicationhistoryservice-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-server-common-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-server-nodemanager-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-server-resourcemanager-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-server-router-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-server-sharedcachemanager-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-server-tests-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-server-timeline-pluginstorage-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-server-timelineservice-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-server-web-proxy-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-services-api-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-services-core-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopyarnhadoop-yarn-submarine-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducelibhamcrest-core-1.3.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducelibjunit-4.11.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducehadoop-mapreduce-client-app-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducehadoop-mapreduce-client-common-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducehadoop-mapreduce-client-core-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducehadoop-mapreduce-client-hs-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducehadoop-mapreduce-client-hs-plugins-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducehadoop-mapreduce-client-jobclient-3.2.1-tests.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducehadoop-mapreduce-client-jobclient-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducehadoop-mapreduce-client-nativetask-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducehadoop-mapreduce-client-shuffle-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducehadoop-mapreduce-client-uploader-3.2.1.jar;C:Hadoophadoop-3.2.1sharehadoopmapreducehadoop-mapreduce-examples-3.2.1.jar STARTUP_MSG: build = https://gitbox.apache.org/repos/asf/hadoop.git -r b3cbbb467e22ea829b3808f4b7b01d07e0bf3842; compiled by 'rohithsharmaks' on 2019-09-10T15:56Z STARTUP_MSG: java = 1.8.0_221 ************************************************************/ 2019-10-13 12:01:58,567 INFO namenode.NameNode: createNameNode [-format] Formatting using clusterid: CID-e07d7b19-b692-418b-a48d-d1b4cfabb51f 2019-10-13 12:01:59,508 INFO namenode.FSEditLog: Edit logging is async:true 2019-10-13 12:01:59,524 INFO namenode.FSNamesystem: KeyProvider: null 2019-10-13 12:01:59,525 INFO namenode.FSNamesystem: fsLock is fair: true 2019-10-13 12:01:59,527 INFO namenode.FSNamesystem: Detailed lock hold time metrics enabled: false 2019-10-13 12:01:59,535 INFO namenode.FSNamesystem: fsOwner = stowl (auth:SIMPLE) 2019-10-13 12:01:59,535 INFO namenode.FSNamesystem: supergroup = supergroup 2019-10-13 12:01:59,535 INFO namenode.FSNamesystem: isPermissionEnabled = true 2019-10-13 12:01:59,540 INFO namenode.FSNamesystem: HA Enabled: false 2019-10-13 12:01:59,595 INFO common.Util: dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO profiling 2019-10-13 12:01:59,611 INFO blockmanagement.DatanodeManager: dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000 2019-10-13 12:01:59,611 INFO blockmanagement.DatanodeManager: dfs.namenode.datanode.registration.ip-hostname-check=true 2019-10-13 12:01:59,624 INFO blockmanagement.BlockManager: dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000 2019-10-13 12:01:59,624 INFO blockmanagement.BlockManager: The block deletion will start around 2019 Oct 13 12:01:59 2019-10-13 12:01:59,628 INFO util.GSet: Computing capacity for map BlocksMap 2019-10-13 12:01:59,632 INFO util.GSet: VM type = 64-bit 2019-10-13 12:01:59,634 INFO util.GSet: 2.0% max memory 889 MB = 17.8 MB 2019-10-13 12:01:59,637 INFO util.GSet: capacity = 2^21 = 2097152 entries 2019-10-13 12:01:59,650 INFO blockmanagement.BlockManager: Storage policy satisfier is disabled 2019-10-13 12:01:59,650 INFO blockmanagement.BlockManager: dfs.block.access.token.enable = false 2019-10-13 12:01:59,658 INFO Configuration.deprecation: No unit for dfs.namenode.safemode.extension(30000) assuming MILLISECONDS 2019-10-13 12:01:59,659 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.threshold-pct = 0.9990000128746033 2019-10-13 12:01:59,663 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.min.datanodes = 0 2019-10-13 12:01:59,667 INFO blockmanagement.BlockManagerSafeMode: dfs.namenode.safemode.extension = 30000 2019-10-13 12:01:59,671 INFO blockmanagement.BlockManager: defaultReplication = 1 2019-10-13 12:01:59,671 INFO blockmanagement.BlockManager: maxReplication = 512 2019-10-13 12:01:59,671 INFO blockmanagement.BlockManager: minReplication = 1 2019-10-13 12:01:59,672 INFO blockmanagement.BlockManager: maxReplicationStreams = 2 2019-10-13 12:01:59,672 INFO blockmanagement.BlockManager: redundancyRecheckInterval = 3000ms 2019-10-13 12:01:59,673 INFO blockmanagement.BlockManager: encryptDataTransfer = false 2019-10-13 12:01:59,673 INFO blockmanagement.BlockManager: maxNumBlocksToLog = 1000 2019-10-13 12:01:59,725 INFO namenode.FSDirectory: GLOBAL serial map: bits=29 maxEntries=536870911 2019-10-13 12:01:59,726 INFO namenode.FSDirectory: USER serial map: bits=24 maxEntries=16777215 2019-10-13 12:01:59,727 INFO namenode.FSDirectory: GROUP serial map: bits=24 maxEntries=16777215 2019-10-13 12:01:59,732 INFO namenode.FSDirectory: XATTR serial map: bits=24 maxEntries=16777215 2019-10-13 12:01:59,755 INFO util.GSet: Computing capacity for map INodeMap 2019-10-13 12:01:59,755 INFO util.GSet: VM type = 64-bit 2019-10-13 12:01:59,757 INFO util.GSet: 1.0% max memory 889 MB = 8.9 MB 2019-10-13 12:01:59,763 INFO util.GSet: capacity = 2^20 = 1048576 entries 2019-10-13 12:01:59,765 INFO namenode.FSDirectory: ACLs enabled? false 2019-10-13 12:01:59,766 INFO namenode.FSDirectory: POSIX ACL inheritance enabled? true 2019-10-13 12:01:59,766 INFO namenode.FSDirectory: XAttrs enabled? true 2019-10-13 12:01:59,771 INFO namenode.NameNode: Caching file names occurring more than 10 times 2019-10-13 12:01:59,781 INFO snapshot.SnapshotManager: Loaded config captureOpenFiles: false, skipCaptureAccessTimeOnlyChange: false, snapshotDiffAllowSnapRootDescendant: true, maxSnapshotLimit: 65536 2019-10-13 12:01:59,783 INFO snapshot.SnapshotManager: SkipList is disabled 2019-10-13 12:01:59,790 INFO util.GSet: Computing capacity for map cachedBlocks 2019-10-13 12:01:59,790 INFO util.GSet: VM type = 64-bit 2019-10-13 12:01:59,791 INFO util.GSet: 0.25% max memory 889 MB = 2.2 MB 2019-10-13 12:01:59,797 INFO util.GSet: capacity = 2^18 = 262144 entries 2019-10-13 12:01:59,814 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.window.num.buckets = 10 2019-10-13 12:01:59,815 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.num.users = 10 2019-10-13 12:01:59,817 INFO metrics.TopMetrics: NNTop conf: dfs.namenode.top.windows.minutes = 1,5,25 2019-10-13 12:01:59,829 INFO namenode.FSNamesystem: Retry cache on namenode is enabled 2019-10-13 12:01:59,829 INFO namenode.FSNamesystem: Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis 2019-10-13 12:01:59,834 INFO util.GSet: Computing capacity for map NameNodeRetryCache 2019-10-13 12:01:59,835 INFO util.GSet: VM type = 64-bit 2019-10-13 12:01:59,835 INFO util.GSet: 0.029999999329447746% max memory 889 MB = 273.1 KB 2019-10-13 12:01:59,836 INFO util.GSet: capacity = 2^15 = 32768 entries Re-format filesystem in Storage Directory root= D:Hadoopdatanamenode; location= null ? (Y or N) y 2019-10-13 12:02:02,200 INFO namenode.FSImage: Allocated new BlockPoolId: BP-1688834052-10.0.0.23-1570986122192 2019-10-13 12:02:02,200 INFO common.Storage: Will remove files: [] 2019-10-13 12:02:02,284 ERROR namenode.NameNode: Failed to start namenode. java.lang.UnsupportedOperationException at java.nio.file.Files.setPosixFilePermissions(Unknown Source) at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.clearDirectory(Storage.java:452) at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:591) at org.apache.hadoop.hdfs.server.namenode.NNStorage.format(NNStorage.java:613) at org.apache.hadoop.hdfs.server.namenode.FSImage.format(FSImage.java:188) at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:1206) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1649) at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1759) 2019-10-13 12:02:02,297 INFO util.ExitUtil: Exiting with status 1: java.lang.UnsupportedOperationException 2019-10-13 12:02:02,306 INFO namenode.NameNode: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down NameNode at DESKTOP-354IRPS/10.0.0.23 ************************************************************/