File Too Big...way To Parse Out Data And Write To Csv

Feb 12, 2010

I have a file with multiple tabs of data...lot's of data (each tab has 80,000+ lines and 23 columns...3 are formulas, the rest is imported data). I've brought Excel to it's knees (i.e. crashes). Yes, I'm using 2007.

What I'm trying to do is extract 6 cells of data from every 10th line and write it out to a CSV file with two more pieces of information (same for each line).

What I was doing was creating a separate worksheet for each one to be extracted, parsing out the data, and then copying that data to yet another workbook that was then saved as a CSV.

First, in retrospect, that was a waste of time. Second, the addition of the extra worksheets to do the parsing was crashing Excel due to the extreme size of the workbook.

What I'd like to do is use a macro to do all of this in one swell foop:

1) Prompt me for a file name (or I can put the desired name in a cell and read it from there if that simplifies the code)
2) Open a new text file with that name and ".csv" extension in the same folder as the original workbook
3) Write out the column headers: (Fix, Satellites, Lat, Lon, alt (ft), Date, utc_t, course)
4) Step through each row, looking at the text contents of column B (looks like 22:50:07.100)...if it ends in ".000" do the following:
4a) write "PPS,4," to the open text file
4b) write the cell contents from columns "V", "W", "J", "C", "B", and "L" to the text file in the exact format they appear in the text cell.

The output file should look like (very short example):

Fix,Satellites,Lat,Lon,alt (ft),Date,utc_t,course
PPS,4,30.543203,-86.323328,1419.04,2009/12/17,23:26:22.000,243.95
PPS,4,30.539272,-86.332765,1831.53,2009/12/17,23:26:34.000,242.61
PPS,4,30.535680,-86.340912,2281.16,2009/12/17,23:26:44.000,244.34

View 9 Replies


ADVERTISEMENT

Parse Only Specific Data Of Text File To Worksheet

Aug 30, 2006

I have a text file with no discernable format ( can't import into excel) that is too large to put all the data into an excel worksheet. This file is made to print out on a network printer.

I don't need all the info in the file, I would like to specify a variable, search the text file for the variable, then specify the amount of rows down to look for the data value and input the result into an excel spreadsheet.

View 3 Replies View Related

Write Data To HTML File With Custom Tags

Nov 14, 2006

I'm trying to take the contents of an excel speadsheet and write it to an html file with my own formatting. For example I would like the row:

|32|55|28|

to end up in the html file as:

<tr>
<td class="align-right">32</td>
<td>55</td>
<td class="">28</td>
</tr>

In theory it seemed fairly simple to loop through a sheet and write before and after each cell, but once I tried writing the code I realized I was in way over my head.

View 9 Replies View Related

Read Pdf Or Doc File Line By Line And Then Parse Data Into Proper Cells And Rows?

Feb 23, 2013

I have the data to import / read in a pdf, in a doc, or in an Excel worksheet whichever is easier to use. I need to import the data, parse it into the correct cells for that row and then repeat the import until the end of the file. Not all the cells are in each group of data to import, so those cells will be null for that row. Some of the data for one cell may be in up to 14 lines in the data file. I have be concatenating these data rows into one cell. There are 48,000 lines in the file to import or I would do this manually. I am assuming that doing this in VBA would be the most efficient method.

View 11 Replies View Related

Import/parse Text File

Feb 16, 2009

I need 3 columns - Title - HD - Channel. If no value for HD, the field would be blank.

Data looks like this in txt file:
> A&E HD 265
> ABC Family HD 311
> Altitude Sports and Entertainment HD 681
> American Movie Classics (AMC) 254
> Animal Planet HD 282
> BBC America 264
> BET Jazz 330
> BYU TV 374
> Big Ten Network HD 220
> Black Entertainment Television (BET) 329
> Bloomberg Television 353
> Boomerang 298

Needs to look like this in Excel
> Should look like:
> A&E HD 265
> ABC Family HD 311
> Altitude Sports and Entertainment HD 681
> American Movie Classics (AMC) 254
> Animal Planet HD 282
> BBC America 264

View 9 Replies View Related

Parse An Output File From X-12-arima Using Vba

Jul 10, 2006

I'm trying to parse an output file from x-12-arima using vba. The file is in this format

.....
invalidate the results of this test For the last three year period.
ICMETI, Total Inventories Communications Equipment PAGE 9, SERIES foo

D 12 Final trend cycle
From 2002.Jan To 2005.Dec
Observations 48
Trend filter 13-term Henderson moving average
I/C ratio 1.08 .............

View 5 Replies View Related

Parse And Import Text File

Jan 29, 2007

I have a software application that imports audio files and writes information about these files to text files. I'm trying to write and Excel/VBA application that will parse and import the data contained in these files. find a sample of one of these files attached. The big hurdle I am facing is I cannot figure out how to parse this file - the delimiter keeps changing as throughout the file (see example below):

otrk ´ptrk ¬
otrk Îptrk Æ
otrk Ôptrk Ì
otrk âptrk Ú
otrk *ptrk "
otrk Øptrk Ð
otrk þptrk ö
otrk ´ptrk ¬
otrk ptrk
otrk Ðptrk È
otrk Þptrk Ö
otrk þptrk ö
otrk ptrk
otrk îptrk æ
otrk ptrk

View 5 Replies View Related

Write VBA Code That Will Generate Text File With ALL Changes Made To Excel File

Jun 4, 2012

Is it possible to write vba code that will generate a text file with ALL changes that were made to an excel file. Ex. If Cell A17 = "Monday, June 4, 2012" and a user updates Cell A17 to "N/A", I would like to know what the value was before and after the udpate was made.

View 8 Replies View Related

Macro To Parse And Open Text File

Apr 2, 2007

1. Open a text file from a directory on my computer
2. Feed the data into a Excel spreadsheet
3. Parse the text from the text file into columns

an example of some of the stuff in the text file (its all fake btw )

192.168.1.216,,,
J2MARTIN,20/08/1999,8:57:27 a.m.,
372,http://www.microsoft.com/isapi/redir.dll?,,
192.168.1.216,,,
J2MARTIN,20/08/1999,8:57:27 a.m.,
326,http://home.microsoft.com/,,
192.168.1.216,,,
J2MARTIN,20/08/1999,8:57:29 a.m.,
37014,http://www.msn.com/default.asp?,,

Is it possible to feed all this data into excel into seperate rows and then start parsing it into columns of

IP Username Date Time KbUsage URL

View 2 Replies View Related

Parse Flat File And Enter It Into Separate Cells

Jul 12, 2012

I receive a flat text file every week which I would like to grab with excel and extract only the data I need and enter the data into separate cells and loop until I reach the end of the flat file. I got a subroutine written that allows me to open my text file and it will enter all the data however I need to know how to parse only the stuff I need and enter it into the right cells and loop until I reach the end of my text file. Here is what I have so far:

Sub testFSNew()
Dim fs As Object ' scripting.filesystemobject
Dim txtIn As Object ' scripting.textstream
Dim strFile As String 'File Name
Dim strLine As String 'Current line being read.

[code].....

Now so far this opens the text file and dumps all the data into an excel spreadsheet however when I say all I mean it dumps everything into the first cell and does not separate it, the following is an example of the text in the flat file. I will only put in the first 5 rows because their is 5000 rows in the real file.

HDR20120710

001010000366175270012008085197804171984102919730621DOE BJ52702B25713700000000016005

00101000036617JOHN 109080 55512345671978093000000001MACHINE REPAIR 4

001010000997885270002010384198910301989103019891030SMITH DS52501C257077S0000000000005

00101000099788ROBERT 109109 55523456781999082700000001ELECTICIAN-PROJECT COORD 4

Ok so the first problem is I don't need the first line it's a header line and if you will notice everyline of the file ends with either a 5 or a 4 but it is information about each employee, so the next line would end in a 5 and that would be the beginning of the next employee.

P.S. I noticed in the preview post that this message board truncated my flat file data, so keep in mind that each line is indeed 1 line ending in either 5 or a 4

View 9 Replies View Related

Parse Text File To Provide Specific Table Like Format

Jun 10, 2009

I need help urgently for parsing a text file to have a specific format. The text file is of format mentioned below: ...

View 9 Replies View Related

Why Won't This Write My Text File

Nov 21, 2006

I have verified that there is data in the worksheet...but while the text file is created and properly closed, nothing is written to it.

Sub ScoresToDeko() 'writes a text file
Dim Scores As String
Dim CRLF As String
Dim count As Integer

Scores = ""
CRLF = Chr$(13) & Chr$(10)

View 9 Replies View Related

Macro To Write CSV File

Dec 14, 2009

I have a CSV file that contains data in columns A-Q. Some cells may be blank.

I'm having trouble opening this CSV file because when I re-save it after editing it, Excel removes any quotes that were around the data.

Here is the criteria that the data must be formatted like:

If the value in column A = "H", the following columns need quotes around the cell - A-F, H-I, K-M, P-Q. The values in the rest of the columns do not need quotes.
If the value in column A = "D", the following columns need quotes around the cell - A-D, F, I-O, Q. The values in the rest of the columns do not need quotes. Data is only in columns A-Q.

Can somebody write a macro that will format the data as list above and save?

View 9 Replies View Related

Write Log To Text File

Jan 7, 2007

Are there any examples, instead of having MsgBox, but have a log file created ?

So instead of MsgBox, it might be MsgLog

Is there such a thing in VBA ?

View 6 Replies View Related

Write To Text File

Jan 4, 2008

I'm getting an object required error in excel, but don't really understand.

rivate Sub CommandButton1_Click()
free_number = FreeFile()
Filename = app.Path & "/file_write_output.txt"
StringToSave = Cells(1, 1).Value
Open Filename For Output As free_number
Write #free_number, StringToSave
Print #free_number, StringToSave
Close #free_number
End Sub

View 7 Replies View Related

Write File Using Cell Value And Given Text

Mar 25, 2009

I found this thread ,

http://www.excelforum.com/excel-prog...in-a-cell.html
on the forum site which involves
saving a file by value in a cell.

I want to change the code so that it saves that name by
a cell value + "_BOM"

View 3 Replies View Related

Write Cell Contents To File?

Jun 2, 2014

Sometimes I want to have the abbility to quickly write cell data to a textfile. This is an effort:

Code:
Function Write_To_File(strMessage As String) As Boolean
'strMessage is a data in a cell
Log strMessage

[Code].....

Basically I want just one function that returns True for a succesfull write and False in case of an error. Now I have one function and one sub.

View 5 Replies View Related

Write A Line Into A HTML File With VBA

Jan 1, 2007

Say there is a HTML file at C:DataFile.html

I'd like to use Excel VBA to write this meta tag into that HTML file:

****** http-equiv="refresh" content="600">
That's to make it refresh every 600 seconds.

The most elegant way would be to locate the "head" tag and write it right after it, but the refreshing meta tag seems to work where ever it is, even at the very end of the file after the "/html" tag! So locating the "head" tag is not that important, if it's difficult.

So, how do I use VBA to write lines into a HTML (or any text) file?

View 9 Replies View Related

Read & Write Mp3 File Tag Properties

May 31, 2008

The problem with the Write macro was that, although it did work, it used SendKeys which has to be slowed down considerably.

Here is a new version of the Write macro that works as normal. I originally tried to use CDDBControl.dll version 1.2.0.51 which is widely available on the internet but found that I could only get it to change 1 file before crashing Excel.

I have put the READ macro in the next message.

Dim ws As Worksheet
Dim FromRow As Long
Dim LastRow As Long
Dim FilesToChange As Integer ' number of files to change
Dim FilesChanged As Integer ' number of files changed
Dim MyFilePathName As String ' full path & file name
Dim MyFileType As String ' mp3 wma etc.
'-
Dim id3 As Object
Dim MyArtist As String
Dim MyAlbum As String
Dim MyGenre As String
Dim MyTrack As String
Dim MyTitle As String

Sub WRITE_TO_EXPLORER()
Application.Calculation = xlCalculationManual
Set ws = ActiveSheet
Set id3 = CreateObject("CDDBControlRoxio.CddbID3Tag")
LastRow = ws.Range("A65536").End(xlUp).Row ' count worksheet rows
FilesToChange = ws.Range("A2:A" & LastRow).SpecialCells(xlCellTypeVisible).Count
If FilesToChange = 0 Then MsgBox ("No files to change."): Exit Sub
FilesChanged = 0........................

View 3 Replies View Related

Read-Write Popup - File Now Available

Apr 29, 2009

I have a tool that accesses a master sheet. Multiple people use the tool (sort of a user interface).

In some cases I need to write to the Master in which I check to make sure its not read only when the macro opens it (that works fine).

In other cases, like when just pulling information, read only is fine. But, I have not specified read only when I open the master.
Sometimes the users are getting a "File Now Available" with a read-write and cancel option. I do not want them to get this message.

My current universal call to master looks like this: ...

View 9 Replies View Related

Excel Macro To Write In Text File

May 30, 2013

I have a excel sheet with rows and columns. I want to use these values to write a text file.

Code:
PR
DTP
DTP
DTB
DTB

E618F0310AFD44CB9881B0E692B68874
E618F0310AFD44CB9881B0E692B68874
063D64761DFC46F485CE86F4F720A1B1
063D64761DFC46F485CE86F4F720A1B1

[Code] .......

Output:

HTML Code:

Project n 1
E618F0310AFD44CB9881B0E692B68874

AA

Project n 1
E618F0310AFD44CB9881B0E692B68874

BB
.
.

.

and so on, until all rows and columns has been written

View 2 Replies View Related

Write A Macro To Delete Columns In A CSV File

Dec 27, 2006

I have a CSV file with the following columns:

column1, Column2, Column3
A, B, "C,D"

I need to write a macro to :

1. Delete column2

2. Save the CSV file. At the time of saving I need to supress all default messages.

View 9 Replies View Related

Open File - Check For Write Protection

Sep 18, 2009

I have a command that opens up another workbook. This workbook is sometimes open on another computer, so that the book opens up on my computer in write-protected mode (shows in the top of the window). Usually, when opening other books through the Excel functionality, a message box appears if the file is open and warns that the file is in use by another user. However, with the code I have at the moment, this is not the case when I try to open with my command. See code below:

Private Sub cmdOpenBook_Click()
'Open book
ChDir "I:DevelopmentSpecialUtvikling"
Workbooks.Open Filename:= _
"I:DevelopmentSpecialUtviklingJointApp.xls"
End Sub

Is there any way of displaying a msgbox warning when opening another file through VBA?

View 9 Replies View Related

Write Folder & File Name Of All Files In Directory

Jul 25, 2007

I need some VBA code to cycle through each and every folder and file in a given root directory and write the file name string to a cell. (does not need to look at the content of sub-folders only the names of all objects sitting directly under the given root.)

View 4 Replies View Related

Parse Data Between 2nd And 3rd Delimiter

Apr 21, 2009

I'm looking for a worksheet function that will allow me to separate into another cell the characters between the second and third slash in the source cell. The number of characters varies, but the value I want is always between the second and third slash.

View 3 Replies View Related

Record/write Macros Independent Of A Specific File

Oct 12, 2009

I have recorded (i.e. manually as opposed to writing VBA code) a number of macros to perform a routine, however they do not work when I change the filename.

Could someone please advise on how to edit these macros (which reference a specific filename) so that they work when the file name is changed. The macros copy and paste values from different worksheets and then run another set of macros. However all macros and worksheets are located within one excel file

View 13 Replies View Related

To Read Many Text Files And Write It In The Excel File

Dec 11, 2009

I need help for reading data from text files and saving it under different columns in the excel file using vba macro.

For example: I have many text files in the following format ....

View 9 Replies View Related

Write Array To Text File On Single Line

Apr 14, 2008

In VBA, is it possible to write to a text file, on 1 single line (without carriage return or line feed) the values of a dynamic array? For instance, I have the array:

Dim my(n) As Double 'n is changeable
my(0) = 0
my(1) = 1
my(2) = 2
.....

I want to write to a text file, like this: Write #filename, my(0), my(1), my(2) '..... until my(n) but n is changing

I want them on 1 line, because I use the other direction (up - down) for other things).

View 2 Replies View Related

Parse Data Out To Individual Sheets

Feb 2, 2014

I have a mastersheet (see attached file) with data on it. I need to parse this data out to individual sheets based on the values in column 8.

Currently I use this code but it only creates sheets with no data in it and it also doesn't rename the sheet tabs.

[Code] .....

Sample.xlsx‎

View 6 Replies View Related

Parse Delimited PDF Data Into Worksheet

Feb 11, 2008

I have a PDF document with an income statement that I'm trying to bring into excel. When I copy it, it puts all of the information in 1 column like this: NET INCOME 183,450 (237,660) 421,110 177 (1,461,273) (1,769,800) 308,526 17
CAPITAL EXPENDITURES Land Improvements 0 0 0 35,000 0 (35,000) Building Improvements 7,500 0 (7,500) 243,129 626,500 383,371 61. I cannot use text to columns, because the CATEGORIES are different in length (3 to 4 to 5 words at times).

I can seperate the numbers from the words, but I can't seperate the numbers from one another. Is there any way that I can do this via a text fuction?

*Example*
0 0 0 35,000 0 (35,000)
7,500 0 (7,500) 243,129 626,500 383,371 61
29,881 310,460 280,579 90 380,580 1,556,576 1,175,996 76
0 83,248 83,248 100 76,765 574,345 497,580 87

View 3 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved