Copy list using csv/txt file.


Recommended Posts

Hi All.

 

At some point in the coming months I may be asked to copy a large number of small photos from a folder to be sent to one of our clients. My problem is that it will be thousands out of around 2.5m and will be given to me in a list, probably a csv or txt file. Normally I would use Robocopy to copy this number of files but it doesn't look like it is a viable answer due to it not being a . Is there a copy tool that I can use to copy files listed in a csv/txt file to a new source?

 

Thanks for the help.

Link to comment
https://www.neowin.net/forum/topic/1197331-copy-list-using-csvtxt-file/
Share on other sites

sure. notepad++

 

Press CTRL-H to bring up the Find/Replace Dialog. Choose the "Regular expressions" checkbox near the bottom of the dialog.

To add "copy " to the beginning of each line, type ^ in the "Find what" field, and "copy " in the "Replace with" field. Then hit "Replace All".

 

then either copy and paste the contents into a batch file or save it as a batch file.

Enjoy.

 

 

 

Thanks sc302

 

Had to modify to ^(.) and Copy \1 for it to work otherwise it returned an error, "The regular expression to search is formed badly" when I hit replace all.

 

Now I have a list that starts Copy Test1.txt, how do I amend it to then include a destination?

 

I have also been looking at Robocopy again as it does seem to have the ability to state the files to copy but I cant get the syntax correct.

 

From Robocopy /? - file :: Files(s) to copy (names/wildcards: default is (*.*).

 

It only copies the last file I list.

Thanks sc302, I will look into how this will work but it should be ok.

 

Stumper66, tried your method with the following,

 

C:\Users\........\COPY TEST>FOR /F %I IN test.txt DO robocopy "C:\Users\........\COPY TEST\Source" "C:\Users\.........\COPY TEST\Destination" %I
 
And got this with no files copied,
 
test.txt was unexpected at this time.
 
What should the test.txt look like? Currently I have tried one entry per line and all on same line separated with a comma but neither work. I also had the test.txt file in both the COPY TEST folder and the source folder and it doesn't seem to like it.

not sure why you would want to use robocopy in this use case? I am a fan of it to be sure, but wouldn't it be easier to use a command that supports a file list directly?

Are you putting that command in a batch file and running it, or just using it on the command line? So if you put it in a file you would need to change to %% vs %

Question - are all the files in the sources folder, no sub folders? So there are 2.5 million files in this one folder? Do any of these files have spaces in the names?

So I did a test without any spaces in names or subfolders.

post-14624-0-47870500-1390312384.png

So my list.txt is in c:\temp the folder I was actually running the command from - you need the () around it. Off the top not sure how you could get around sub folders in your source? Spaces in the names you might be able to get around with "'s in the textfile and using /F tokens= option..

Other than that you could have lists and run the command for every source folder... But as you can see list.txt is just list of the file names.

Perfect (almost) Budman.

 

All photos are in the single folder, no subfolders and no gap in names.

 

I had attempted the command earlier but didn't include the ()'s so hit an error, didn't occur to me they were required.

 

I also added /LOG+:log.txt but the log creates an entry for each file copied appended to a single file, do you know if it can be modified to show a summary for all in one entry?

Summary would work if it was one robocopy command, but the way that loop works is your calling robocopy each copy, that my point of maybe using something else that supports lists (off the top not sure what).

But in this case your just looping a call of robocopy source dest file, each time.. So sure you could append to the same file, but see in my above screen shot how you get a summary of the dig copy, above that is the summary of each file that was copied before.

If you copied all the files in one call of robocopy then you would get a summary of what robocopy did.

As to 2.5m files in 1 folder -- man that must take for ever to come up in explorer ;)

No problem.

If and when they want the pictures and the log they can use CTRL+F to see if the file they are looking for has copied.

I asked them to change the structure to one folder per month but for what ever the reason was it didn't happen. The previous 2003 R2 box used to completely hang if we tried to do anything with this folder, even a simple right click!

Thanks again, we are going to test this with a large number of files and see how it copes but what I have been testing with so far works perfectly.

  • 1 year later...

Is it possible to post the complete code to batch copy image filenames using txt file or excel file one column image filename and 2nd column with the destination folder. A subfolder within source folder. batch or whatever program that will allow me to do this quickly. Would appreciate, the help! Thanks!

This topic is now closed to further replies.
  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Posts

    • Ah yes, nothing says 'user-friendly' like 500 distros and 0 standards.
    • If this doesn't become the year of the Linux desktop, then it will never come. They already wasted the Windows Vista fiasco, the Windows 8 fiasco, let's see what will happen now.
    • Linux is the way to go, so many distributers with great offerings, no more bloatware with Windows 11, the Linux operating system boots much more quickly with much lower CPU requirements, why wouldn't you if you only need a great browsers to access online services.
    • Master PDF Editor 5.9.90 by Razvan Serea Master PDF Editor is straightforward, easy to use application for working with PDF documents equipped with powerful multi-purpose functionality. With Master PDF Editor you can easily view, create and modify PDF documents. The application enables you to merge several files into one, split a source document into multiple documents, and also to comment, sign and encrypt PDF files. Master PDF Editor – Features at a glance: Edit PDF text, images and pages with full editing features. Create new PDF or edit existing ones. Add and/or edit bookmarks in PDF files. Encrypt and/or protect PDF files using 128 bit encryption. Convert XPS files into PDF. Add PDF controls (like buttons, checkboxes, lists, etc.) into your PDFs. Import/export PDF pages into common graphical formats including BMP, JPG, PNG, and TIFF. Split and merge PDF files. JavaScript support. Dynamic XFA form support. Validation Forms and Calculate Values. Fast and simple PDF forms fill out. Signing PDF documents with digital signature, signatures creation and validation. Changing font attributes (size, family, color etc). Master PDF Editor 5.9.90 changelog: Added support for page alignment options. Added the function to save search history. Added support for Z-reordering multiple objects simultaneously. Fractional scale values are supported during printing. General improvements and fixes for file saving. Fixed issues related to PDF page display. Fixed problems related to navigation between pages. Improved compatibility with XFA-based PDF documents. Bug fix for text object editing. Fixed bugs related to page cropping. Enhanced detection of conflicting keyboard shortcuts. Resolved printing issues. Fixed a bug related to increase in the file size when scanning. Fixed PDF preview rendering in Microsoft Outlook. Resolved an issue with opening Certificate Manager on macOS. Download: Master PDF Editor 64-bit | Master PDF Editor 32-bit ~60.0 MB (Shareware) Download: Master PDF Editor for Linux | 66.8 MB Download: Master PDF Editor for macOS | 59.8 MB View: Master PDF Editor Home Page | Release History | Screenshot Get alerted to all of our Software updates on Twitter at @NeowinSoftware
    • NTLite 2025.06.10456 by Razvan Serea NTLite is a Windows configuration tool that allows you to modify your existing Windows install or an image yet to be deployed, remove Windows components, configure and integrate, speed up the Windows deployment process. Reduce Windows footprint on your RAM and storage drive memory. Remove components of your choice, guarded by compatibility safety mechanisms, which speed up finding that sweet spot. Windows Unattended feature support, providing many commonly used options on a single page for easy setup. Easily integrate a single or multiple drivers, update or language packages. Package integration features smart sorting, enabling you to seamlessly add packages for integration and the tool will apply them in the appropriate order, keeping hotfix compatibility in check. One of the important new features of NTLite (compared to its predecessors) is the ability to modify an already installed the operating system, by removing unnecessary components. Supports Windows 11, 10, 8.1 and 7, x86 and x64, live and image. Server editions of the same versions, excluding support for component removals and feature configuration. ARM64 image support in the alpha stage. Does not support Checked/Debug, Embedded, IoT editions, nor Vista or XP. NTLite 2025.06.10456 changelog: New Image: Windows 11 24H2 Preview build 26120 support Components: ‘Microsoft Platform Thermal Framework (MPTF)’ Components: ‘Inter-Integrated Circuit (I2C)’ Components: ‘Windows Hotpatching’ Settings: ‘Share any window from my taskbar’ Upgrade Image: Faster removal of editions if only one kept for a given image Components: ‘Windows Feature Experience Pack – SXS’ is a merger of new 24H2 components: Taskbar, Filons, Voiess, Speion, Livtop and InpApp Features: Win11 24H2 image shows a few more Features on Demand, including .NET 3.5 UI-Translation: Thanks for Chinese Traditional (Matt), French (tistou77), Hungarian (John), Italian (clarensio), Russian (RDS), Turkish (Salih DURDU) Fix Components: ‘Internet printing’ is needed for Host Refresh if Printing kept (investigating, cannot even just disable it) Settings: Wallpaper Style value fixes Download: NTLite 64-bit | 21.2 MB (Free, paid upgrade available) Download: NTLite 32-bit | 18.8 MB Link: NTLite Home Page | NTLite Features | Screenshot Get alerted to all of our Software updates on Twitter at @NeowinSoftware
  • Recent Achievements

    • One Year In
      fred8615 earned a badge
      One Year In
    • Week One Done
      Jim Dugan earned a badge
      Week One Done
    • Week One Done
      Adam Todd earned a badge
      Week One Done
    • Contributor
      Ed B went up a rank
      Contributor
    • One Month Later
      moporcho earned a badge
      One Month Later
  • Popular Contributors

    1. 1
      +primortal
      214
    2. 2
      snowy owl
      156
    3. 3
      ATLien_0
      134
    4. 4
      Xenon
      123
    5. 5
      +FloatingFatMan
      114
  • Tell a friend

    Love Neowin? Tell a friend!