Script to write all filenames inside a folder and its subfolders to a csv file

Question

I would like to write a shell script in order to write all files ending with .tif in a given directory and all its subdirectories to a csv file.

The directory contains various sub-directories and those can also contain .zip folders so the script should be able to extract the names from zip folders too.

I first thought about separating these steps though (unzipping and getting the filenames) but I'm not sure if this is really necessary.

Since I'm really new to working with the Shell, any help would be appreciated.

How to loop through sub folders? http://askubuntu.com/questions/406462/batch-convert-images-from-one-format-to-another-while-maintaining-directory-stru/ — user.dz, Jan 20 '14 at 17:48

score 7 · Accepted Answer · edited Apr 13 '17 at 12:37

7

To search for .tif files inside a folder and its subfolders, then write the output in a .csv file you can use the following command:

find /path/to/folder -iname '*.tif' -type f >tif_filenames.csv

To search also inside .zip files and append the output to the previous tif_filenames.csv file you can use:

find /path/to/folder -iname '*.zip' -type f -exec unzip -l '{}' \; | process

where process is the following bash function:

function process() {
  while read line; do
    if [[ "$line" =~ ^Archive:\s*(.*) ]] ; then
      ar="${BASH_REMATCH[1]}"
    elif [[ "$line" =~ \s*([^ ]*\.tif)$ ]] ; then
      echo "${ar}: ${BASH_REMATCH[1]}"
    fi
  done
}

^{Source: https://unix.stackexchange.com/a/12048/37944}

edited Apr 13 '17 at 12:37

Community

1

answered Jan 20 '14 at 18:58

Radu Rădeanu

169,590

I think it will be *.tif instead of *.sh. Isn't it? – sourav c. Jan 20 '14 at 19:16
@souravc Yes, you have right. I tested those commands for .sh files. – Radu Rădeanu Jan 20 '14 at 20:02
me too. That is why I noticed it. One more thing in the first case your output will consist the path with its name. – sourav c. Jan 20 '14 at 20:08
@souravc Yep, this was my intention. The OP didn't didn't specified clear this and for me is better to see the full path for files. – Radu Rădeanu Jan 20 '14 at 20:14
1

thanks for your help. it worked for me. another way to retrieve names inside zip files is: unzip -l mypath/myfile.zip | awk '{print $NF}' >> echo /home/myname/mylist.csv – Joschi Jan 22 '14 at 13:39
Hey, would you know how to modify the first one liner to have it only keep the filnames (disregard the paths)? – user2413 Jun 17 '16 at 07:50

score 0 · Answer 2 · answered Jan 20 '14 at 19:31

You can use the code given below,

#!/bin/bash

for f in $(find . -iname "*.tif" -type f)
do
    echo "$(basename $f)"
done

for f in $(find . -iname "*.zip" -type f)
do
    less $f | grep "tif" | awk '{print $NF}'
done

Save the file say as find_tif.sh in the directory where all the tif files and sub directories are located. give it executable permission.

chmod +x find_tif.sh

Useage

./find_tif.sh >> tif_name_file.csv

Script to write all filenames inside a folder and its subfolders to a csv file

2 Answers2