Shell Script Help on file reading


Recommended Posts

Hi,

I need a little help on file reading. I have a file and its contents are like

123456789123456789123456789

987654321987654321987654321

231297301283120381290382133

Now I need script to format this file like

A B C D E F G H I J K L M

123 456 789 123 456 789 12 3 4 56 7 8 9

987 654 321 987 654 321 98 7 6 54 3 2 1

231 297 301 283 120 381 29 0 3 82 1 3 3

i.e the first line shows the differentiating columns and the rest of the lines following those columns.

Please help me on how this can be done.

Thank you.

Link to comment
https://www.neowin.net/forum/topic/1136228-shell-script-help-on-file-reading/
Share on other sites

Is the break down the same,

3-digits 3-digits 3-digits 3-digits 3-digits 3-digits 2-digits 1-digit 1-digit 2-digits 1-digit 1-digit?

This might be an awkward way about the problem but,

#! /bin/bash

for i in `cat filename.ext`;

do

echo ${i:0:2} ${i:3:6} ${i:7:9} ${i:10:12} ${i:13:15} ${i:16:18} ${i:19:20} ${i:21:21} ${i:22:22} ${i:23:24} ${i:25:25} ${i:26:26} >> outputfiles.ext

done;

Clearly not the cleanest way of doing it - P.s. I have not tested this as I am on an android phone lol

You are very close. This is exactly what I want. In simple terms, I want to break the characters and present them in a format like first three characters. then 4-6. then 7-12, then 8-9 and so on. The length of each line in the file remains the same and so I need to format it in different ways.

I tested your code, but the output is not coming according to the code. It would have been perfect otherwise.

Thank you :)

I tested your code, but the output is not coming according to the code. It would have been perfect otherwise.

Do you mean,

1: The wrong number of digits broke down? (Which is possible as I wrote that on an Andriod phone and I cannot see the whole block of code.)

2: The IFS the internal field separate is not triggering the line breaks? (Which is possible depending on where and what is used to create the file in the first place)

This is coming as output of your code

12 456789 891234567 23456789 56789 89

98 654321 219876543 87654321 54321 21

12 121112 123123124 12312412 12412 12

This is not consistent with the code. Your code has divided each line into 12 parts. Therefore the output should have been in 12 parts. The file has been created just by typing the lines to check how it can be broken up.

I would be interested in knowing what this is for LOL

I did the example from memory and I made a mistake in thinking is Variable:Start Reference:End Reference where in actuality it is Variable:Start Reference:Length

#

# YOUR EXAMPLE

#

[Tim.IT-8] ? cat example.txt

123456789123456789123456789

987654321987654321987654321

231297301283120381290382133

#

# SCRIPT

#

[Tim.IT-8] ? cat example.sh

#! /bin/bash

# VARIABLES

INPUTFILE=example.txt

OUTPUTFILE=example_completed.txt

# CLEAR THE SCREEN

clear

# PROCESS

for i in `cat $INPUTFILE`;

do

echo "${i:0:3} ${i:3:3} ${i:6:3} ${i:9:3} ${i:12:3} ${i:15:3} ${i:18:2} ${i:20:1} ${i:21:1} ${i:22:2} ${i:24:1} ${i:25:1} ${i:26:1}" >> $OUTPUTFILE;

done;

# CLEANUP

unset INPUTFILE;

unset OUTPUTFILE;

#

# RESULTS

#

[Tim.IT-8] ? cat example_completed.txt

123 456 789 123 456 789 12 3 4 56 7 8 9

987 654 321 987 654 321 98 7 6 54 3 2 1

231 297 301 283 120 381 29 0 3 82 1 3 3

#

# YOUR EXPECTATION

#

A B C D E F G H I J K L M

123 456 789 123 456 789 12 3 4 56 7 8 9

987 654 321 987 654 321 98 7 6 54 3 2 1

231 297 301 283 120 381 29 0 3 82 1 3 3

  • 2 months later...

Hi tim, sorry for the delayed response.

I checked your code and thanx a ton for this. It is now coming as expected. I also understood the code this time. I have a file where the lines are like

xyz12345	 12345    mprls   12345

Here the blank spaces are also character and every bit of it represents a format. e.g 1st 3 letters will represent something, 4 something else, 5-6, 7-9 and so on. It is for my own clarity, otherwise I have to debug the code manually where the debug file consists of thousands of such lines of equal width and the same format.

Thanx a lot for this. I will check this again on the raw file and if it can format the blank spaces as well.

This topic is now closed to further replies.
  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Posts

    • YouTube has finally brought back its DMs feature, but only in these countries by David Uzondu Late last year, YouTube started testing a "new" way to share videos directly with friends, without having to leave the app. Now, the video giant has announced that is now rolling out a revamped direct messaging inbox, which lets you share videos, Shorts, and live streams and have conversations about them, directly on YouTube. The platform limits this feature to 18+ users who are signed in to a verified channel and use the latest mobile app version. Direct messaging on YouTube first became a thing back in 2017 inside the mobile app (later renamed to "Messages"), where users could chat one-on-one and share clips directly, but all that came to an end on September 18, 2019, when Google decided to shut it down after giving users a month to download a .zip file archive of their past chats. No one really knows why YouTube killed the feature, but users were encouraged to migrate to the public Comments section, on Community tab posts, and via YouTube Stories. The previous incarnation suffered from moderation challenges, prompting Google to implement stricter safety guidelines and age verifications for this new iteration. Here's a list of the countries where the re-launched feature is currently available, though note that Brand Accounts do not have access to it, at least for now: Countries American Samoa Austria Belgium Brazil Bulgaria Croatia Cyprus Czech Republic Denmark Estonia Finland France Germany Greece Guam Hungary Iceland Ireland Italy Latvia Liechtenstein Lithuania Luxembourg Malta Netherlands Northern Mariana Islands Norway Poland Portugal Puerto Rico Romania Singapore Slovakia Slovenia Spain Sweden Switzerland U.S. Virgin Islands United Kingdom United States Before you can use the feature, you first have to send an invite link to your contact. Invite links expire exactly seven days after you create them. If the person on the other end accepts the invite, you can exchange videos directly and text back and forth inside the app. To delete a message, just long-press on the message and tap unsend to remove it for both users. You can also delete entire conversations by long-pressing the thread and selecting delete, but the other person will continue to see the chat history on their end. To make sure everything remains safe, YouTube monitors these messages to ensure they follow Community Guidelines.
    • The problem of course is simply that government does not always know best. My point is that agency is taken away from the EU consumer in these cases. I'm sorry, but I do not believe that governments (politicians) are inherently good, and "looking out for me." Primarily they look to themselves and their own personal desires first, foremost, and always. When the EU or the DOJ fines these companies, claiming to "represent the welfare of the consumer," how much of these billion-dollar judgments are handed to the consumers they claim to represent? Not even a dollar, as I've seen. Yet the EUC lawyers who are paid to sit around and dream up these suits make huge commissions on the fines the EUC adjudicates, which is an ironclad fact I hope everyone is aware of. It's also rank corruption, of course, but that's another topic. Last, when the EU inflicts these judgments, or the DOJ, take your pick, the costs are bundled right along in the cost of the goods and services these companies provide the consumers they are "looking out for." If you are someone who believes his government is his savior then you have my condolences. I think Apple is right here, because the whole scheme of consumer choice is that consumers pick and choose among the products companies offer. Microsoft Windows is more compatible with third party software and hardware than any desktop OS on Earth, which is my sole reason for choosing it. Just because the EUC forces companies do certain things it knows the companies do not want to do, "or else", has no bearing on consumer benefit. This Siri thing is almost idiotic it's so infantile. But this is what the EUC does when the EU in Brussels becomes cash-strapped and needs a big infusion of cash. Some people get upset by "big companies" but it's the opposite when governments dwarf the size and scope of these companies, which is so obvious it hurts.... I mean you can't honestly believe that forcing Apple to do things with Siri it has its own reasons to decline is something that "opens up" Apple, do you? Say it aint' so...
    • Looks like many years since the request was made, a directory tree view finally may be added. https://github.com/files-community/Files/pull/18537
    • Is it still super slow or has it improved on that area?
    • There's this from last year https://gist.github.com/threat...364659a8887841aa43deca4efd9 but nothing about a buffer overflow that MS somehow can't code against. No matter what, it makes sense to take a "protected by default" approach.
  • Recent Achievements

    • One Month Later
      sjbousquet earned a badge
      One Month Later
    • Week One Done
      sjbousquet earned a badge
      Week One Done
    • First Post
      DragonOfMercy earned a badge
      First Post
    • First Post
      bella52 earned a badge
      First Post
    • Reacting Well
      Techinmay earned a badge
      Reacting Well
  • Popular Contributors

    1. 1
      +primortal
      501
    2. 2
      PsYcHoKiLLa
      214
    3. 3
      +Edouard
      156
    4. 4
      Steven P.
      84
    5. 5
      FloatingFatMan
      72
  • Tell a friend

    Love Neowin? Tell a friend!