How to move files to hdfs in hadoop using unix command Announcing the arrival of Valued...

How much radiation do nuclear physics experiments expose researchers to nowadays?

How can players work together to take actions that are otherwise impossible?

Does accepting a pardon have any bearing on trying that person for the same crime in a sovereign jurisdiction?

When is phishing education going too far?

Is there a "higher Segal conjecture"?

Is the Standard Deduction better than Itemized when both are the same amount?

Why does Python start at index -1 when indexing a list from the end?

Is there a concise way to say "all of the X, one of each"?

I need to find the potential function of a vector field.

Do I really need recursive chmod to restrict access to a folder?

What LEGO pieces have "real-world" functionality?

Does surprise arrest existing movement?

Is 1 ppb equal to 1 μg/kg?

Why is "Captain Marvel" translated as male in Portugal?

Antler Helmet: Can it work?

What would be the ideal power source for a cybernetic eye?

Can Pao de Queijo, and similar foods, be kosher for Passover?

Why did the IBM 650 use bi-quinary?

Should I call the interviewer directly, if HR aren't responding?

Why one of virtual NICs called bond0?

Is the address of a local variable a constexpr?

How does a Death Domain cleric's Touch of Death feature work with Touch-range spells delivered by familiars?

Why constant symbols in a language?

What are 'alternative tunings' of a guitar and why would you use them? Doesn't it make it more difficult to play?



How to move files to hdfs in hadoop using unix command



Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)How to move only files in UnixRegarding Unix Move CommandMove files to folders in UNIXUnix command to find files read by specific userUnix: copy files sequentiallyUnix command for recursively copying filesCopy data from local disk to hdfs in a federation of HDFSDeleting filtered files in Unix using ScriptHow to edit HDFS group?How can I copy(or move) and rename multiple files from different directories using the unix cp command?





.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box;
}







0















I have 2 directories "dft" and "hdfs" in the unpacked Hadoop folder. I am trying to copy the file(StartUnit.txt) in dft into hdfs.
The corresponding command and exception are as shown below



313159@PC213710 ~/hadoop-0.19.1
$ bin/hadoop dfs -copyFromLocal D:/eclipse/cygwin/home/313159/hadoop-0.19.1/hdfs
D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt

HADOOP_NAMENODE_OPTS=-Dcom.sun.management.jmxremote
HADOOP_SECONDARYNAMENODE_OPTS=-Dcom.sun.management.jmxremote
HADOOP_DATANODE_OPTS=-Dcom.sun.management.jmxremote
HADOOP_BALANCER_OPTS=-Dcom.sun.management.jmxremote
HADOOP_JOBTRACKER_OPTS=-Dcom.sun.management.jmxremote
HADOOP_PID_DIR=-Dcom.sun.management.jmxremote
copyFromLocal: Pathname /D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt
from D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt is not a
valid DFS filename.
Usage: java FsShell [-copyFromLocal <localsrc> ... <dst>]


can someone suggest me...










share|improve this question














bumped to the homepage by Community yesterday


This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.






migrated from stackoverflow.com Oct 23 '13 at 14:38


This question came from our site for professional and enthusiast programmers.

























    0















    I have 2 directories "dft" and "hdfs" in the unpacked Hadoop folder. I am trying to copy the file(StartUnit.txt) in dft into hdfs.
    The corresponding command and exception are as shown below



    313159@PC213710 ~/hadoop-0.19.1
    $ bin/hadoop dfs -copyFromLocal D:/eclipse/cygwin/home/313159/hadoop-0.19.1/hdfs
    D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt

    HADOOP_NAMENODE_OPTS=-Dcom.sun.management.jmxremote
    HADOOP_SECONDARYNAMENODE_OPTS=-Dcom.sun.management.jmxremote
    HADOOP_DATANODE_OPTS=-Dcom.sun.management.jmxremote
    HADOOP_BALANCER_OPTS=-Dcom.sun.management.jmxremote
    HADOOP_JOBTRACKER_OPTS=-Dcom.sun.management.jmxremote
    HADOOP_PID_DIR=-Dcom.sun.management.jmxremote
    copyFromLocal: Pathname /D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt
    from D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt is not a
    valid DFS filename.
    Usage: java FsShell [-copyFromLocal <localsrc> ... <dst>]


    can someone suggest me...










    share|improve this question














    bumped to the homepage by Community yesterday


    This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.






    migrated from stackoverflow.com Oct 23 '13 at 14:38


    This question came from our site for professional and enthusiast programmers.





















      0












      0








      0








      I have 2 directories "dft" and "hdfs" in the unpacked Hadoop folder. I am trying to copy the file(StartUnit.txt) in dft into hdfs.
      The corresponding command and exception are as shown below



      313159@PC213710 ~/hadoop-0.19.1
      $ bin/hadoop dfs -copyFromLocal D:/eclipse/cygwin/home/313159/hadoop-0.19.1/hdfs
      D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt

      HADOOP_NAMENODE_OPTS=-Dcom.sun.management.jmxremote
      HADOOP_SECONDARYNAMENODE_OPTS=-Dcom.sun.management.jmxremote
      HADOOP_DATANODE_OPTS=-Dcom.sun.management.jmxremote
      HADOOP_BALANCER_OPTS=-Dcom.sun.management.jmxremote
      HADOOP_JOBTRACKER_OPTS=-Dcom.sun.management.jmxremote
      HADOOP_PID_DIR=-Dcom.sun.management.jmxremote
      copyFromLocal: Pathname /D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt
      from D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt is not a
      valid DFS filename.
      Usage: java FsShell [-copyFromLocal <localsrc> ... <dst>]


      can someone suggest me...










      share|improve this question














      I have 2 directories "dft" and "hdfs" in the unpacked Hadoop folder. I am trying to copy the file(StartUnit.txt) in dft into hdfs.
      The corresponding command and exception are as shown below



      313159@PC213710 ~/hadoop-0.19.1
      $ bin/hadoop dfs -copyFromLocal D:/eclipse/cygwin/home/313159/hadoop-0.19.1/hdfs
      D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt

      HADOOP_NAMENODE_OPTS=-Dcom.sun.management.jmxremote
      HADOOP_SECONDARYNAMENODE_OPTS=-Dcom.sun.management.jmxremote
      HADOOP_DATANODE_OPTS=-Dcom.sun.management.jmxremote
      HADOOP_BALANCER_OPTS=-Dcom.sun.management.jmxremote
      HADOOP_JOBTRACKER_OPTS=-Dcom.sun.management.jmxremote
      HADOOP_PID_DIR=-Dcom.sun.management.jmxremote
      copyFromLocal: Pathname /D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt
      from D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt is not a
      valid DFS filename.
      Usage: java FsShell [-copyFromLocal <localsrc> ... <dst>]


      can someone suggest me...







      unix hadoop cygwin






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Oct 23 '13 at 10:26









      ShreyuthShreyuth

      1111




      1111





      bumped to the homepage by Community yesterday


      This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.







      bumped to the homepage by Community yesterday


      This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.






      migrated from stackoverflow.com Oct 23 '13 at 14:38


      This question came from our site for professional and enthusiast programmers.









      migrated from stackoverflow.com Oct 23 '13 at 14:38


      This question came from our site for professional and enthusiast programmers.
























          2 Answers
          2






          active

          oldest

          votes


















          0














          First the source (local file system) and then the target (HDFS) have to be specified. Run the command as below and it should work.



          bin/hadoop dfs -mkdir /hdfs
          bin/hadoop dfs -copyFromLocal D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt /hdfs/StartUnit.txt





          share|improve this answer
























          • hadoop fs -moveFromLocal /home/Desktop/project/data/access-0.log hdfs://localhost:54310 project/data/access-0.log nothing happen?

            – NIMISHAN
            Jan 4 '16 at 7:27



















          0














          The issue is solved now. Here is the solution.



          313159@PC213710 ~/hadoop-0.19.1

          $ bin/hadoop fs –copyFromLocal testdriver/sample.txt /user/cts/313159/In


          This command copies sample.txt file in the directory testdriver into the hdfs dir In.



          If the path /user/cts/313159/In, this command creats path and copies the file into it.






          share|improve this answer


























          • If this is the solution to your issue, you should marke the answer as accepted.

            – simlev
            Mar 28 '17 at 13:00












          Your Answer








          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "3"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f664261%2fhow-to-move-files-to-hdfs-in-hadoop-using-unix-command%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          2 Answers
          2






          active

          oldest

          votes








          2 Answers
          2






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes









          0














          First the source (local file system) and then the target (HDFS) have to be specified. Run the command as below and it should work.



          bin/hadoop dfs -mkdir /hdfs
          bin/hadoop dfs -copyFromLocal D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt /hdfs/StartUnit.txt





          share|improve this answer
























          • hadoop fs -moveFromLocal /home/Desktop/project/data/access-0.log hdfs://localhost:54310 project/data/access-0.log nothing happen?

            – NIMISHAN
            Jan 4 '16 at 7:27
















          0














          First the source (local file system) and then the target (HDFS) have to be specified. Run the command as below and it should work.



          bin/hadoop dfs -mkdir /hdfs
          bin/hadoop dfs -copyFromLocal D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt /hdfs/StartUnit.txt





          share|improve this answer
























          • hadoop fs -moveFromLocal /home/Desktop/project/data/access-0.log hdfs://localhost:54310 project/data/access-0.log nothing happen?

            – NIMISHAN
            Jan 4 '16 at 7:27














          0












          0








          0







          First the source (local file system) and then the target (HDFS) have to be specified. Run the command as below and it should work.



          bin/hadoop dfs -mkdir /hdfs
          bin/hadoop dfs -copyFromLocal D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt /hdfs/StartUnit.txt





          share|improve this answer













          First the source (local file system) and then the target (HDFS) have to be specified. Run the command as below and it should work.



          bin/hadoop dfs -mkdir /hdfs
          bin/hadoop dfs -copyFromLocal D:/eclipse/cygwin/home/313159/hadoop-0.19.1/dft/StartUnit.txt /hdfs/StartUnit.txt






          share|improve this answer












          share|improve this answer



          share|improve this answer










          answered Oct 23 '13 at 12:51









          Praveen SripatiPraveen Sripati

          59531338




          59531338













          • hadoop fs -moveFromLocal /home/Desktop/project/data/access-0.log hdfs://localhost:54310 project/data/access-0.log nothing happen?

            – NIMISHAN
            Jan 4 '16 at 7:27



















          • hadoop fs -moveFromLocal /home/Desktop/project/data/access-0.log hdfs://localhost:54310 project/data/access-0.log nothing happen?

            – NIMISHAN
            Jan 4 '16 at 7:27

















          hadoop fs -moveFromLocal /home/Desktop/project/data/access-0.log hdfs://localhost:54310 project/data/access-0.log nothing happen?

          – NIMISHAN
          Jan 4 '16 at 7:27





          hadoop fs -moveFromLocal /home/Desktop/project/data/access-0.log hdfs://localhost:54310 project/data/access-0.log nothing happen?

          – NIMISHAN
          Jan 4 '16 at 7:27













          0














          The issue is solved now. Here is the solution.



          313159@PC213710 ~/hadoop-0.19.1

          $ bin/hadoop fs –copyFromLocal testdriver/sample.txt /user/cts/313159/In


          This command copies sample.txt file in the directory testdriver into the hdfs dir In.



          If the path /user/cts/313159/In, this command creats path and copies the file into it.






          share|improve this answer


























          • If this is the solution to your issue, you should marke the answer as accepted.

            – simlev
            Mar 28 '17 at 13:00
















          0














          The issue is solved now. Here is the solution.



          313159@PC213710 ~/hadoop-0.19.1

          $ bin/hadoop fs –copyFromLocal testdriver/sample.txt /user/cts/313159/In


          This command copies sample.txt file in the directory testdriver into the hdfs dir In.



          If the path /user/cts/313159/In, this command creats path and copies the file into it.






          share|improve this answer


























          • If this is the solution to your issue, you should marke the answer as accepted.

            – simlev
            Mar 28 '17 at 13:00














          0












          0








          0







          The issue is solved now. Here is the solution.



          313159@PC213710 ~/hadoop-0.19.1

          $ bin/hadoop fs –copyFromLocal testdriver/sample.txt /user/cts/313159/In


          This command copies sample.txt file in the directory testdriver into the hdfs dir In.



          If the path /user/cts/313159/In, this command creats path and copies the file into it.






          share|improve this answer















          The issue is solved now. Here is the solution.



          313159@PC213710 ~/hadoop-0.19.1

          $ bin/hadoop fs –copyFromLocal testdriver/sample.txt /user/cts/313159/In


          This command copies sample.txt file in the directory testdriver into the hdfs dir In.



          If the path /user/cts/313159/In, this command creats path and copies the file into it.







          share|improve this answer














          share|improve this answer



          share|improve this answer








          edited Sep 9 '15 at 3:00









          JakeGould

          32.9k10100142




          32.9k10100142










          answered Nov 13 '13 at 5:11









          ShreyuthShreyuth

          1111




          1111













          • If this is the solution to your issue, you should marke the answer as accepted.

            – simlev
            Mar 28 '17 at 13:00



















          • If this is the solution to your issue, you should marke the answer as accepted.

            – simlev
            Mar 28 '17 at 13:00

















          If this is the solution to your issue, you should marke the answer as accepted.

          – simlev
          Mar 28 '17 at 13:00





          If this is the solution to your issue, you should marke the answer as accepted.

          – simlev
          Mar 28 '17 at 13:00


















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Super User!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f664261%2fhow-to-move-files-to-hdfs-in-hadoop-using-unix-command%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          VNC viewer RFB protocol error: bad desktop size 0x0I Cannot Type the Key 'd' (lowercase) in VNC Viewer...

          Couldn't open a raw socket. Error: Permission denied (13) (nmap)Is it possible to run networking commands...

          Why not use the yoke to control yaw, as well as pitch and roll? Announcing the arrival of...