Pivoting Data In Excess Of 65k Rows

Apr 24, 2008

I've exported some data from our finance system into Excel and now need to pivot it, problem is that there are 100k plus rows and therefore goes across more than 1 worksheet. Had a read through the forum and a number of topics about this but I'm a bit stuck. I've got as far as

1. Ungroup the 2 sheets, copied the row headers from sheet 1 to sheet 2 and then named the data in each sheet. I therefore have 2 identically arranged data ranges (albeit one is 65k rows the other 40k rows) named 'block1' and 'block2'

2. In a new workbook I've done

Data > Import External Data > New Database Query

3. I followed the wizard and slected Block1 as the table

4. In MSQuery I've edited the SQL to read

SELECT * from block1 union all select * from block2

I'm now stuck and have 2 issues

1 I'm only showing 8192 records is this a limitaion of MSQuery or has something gone wrong ?

2. I still don't know how I pivot the data

View 9 Replies


ADVERTISEMENT

Removing Excess Rows

Mar 30, 2009

I've got a spreadsheet that uses about 2200 rows and about 15 columns. However, when I try to insert a column, it freezes up the application. My assumption is that this is caused by the fact that there are in excess of 65,000 rows. When I try to highlight those 63,000 rows and delete them, the system freezes up as well.

These excess rows are unnecessary and I'm sure add to the file size.

Running Windows XP with Excel 2003.

View 9 Replies View Related

Download In Excess Of 65536 Rows

Dec 8, 2007

i'm working with downloading data from our server. it downloads in excel 3.0 format, and the contents exceed the 65k cap by far.

now what i used to do for this when i had 2003 installed on my machine, i would open the 3.0 format file and convert it to 2003 format so i could import it into access, where i could move it into two 2003 xls files to manage by use of copy/paste from access's table to excel's spreadsheet. The 3.0 > 2003 conversion was necessary because if i try to import a 3.0 excel file into access 2003, it gives me a error that the file contains no data.

so here is my problem now. our office just updated to 2007. it appears that when you run the conversion option to 2007 format, OR just save as... and save it to a new xlsx, it stripps off the remaining data that overstacks the 3.0 format file. everything above row 65536 is lost (and this paticular file has 77k+ rows).

so i decided... "ok then i'll do it my old way". i saved it into 2003 format instead, just as i used to, and imported it into access, and guess what? it stripps it in that format too now! (the majesty of upgrades... buggs to year 2010).

so my question is... how do i get this 3.0 overstacked file format converted to xlsx format retaining ALL 77k rows in a single sheet, or how do i strip it into 2 separate xls 2003 format files? either way will work, i just need all my data so i can work with it.

View 9 Replies View Related

Macro To Delete Excess Data

Feb 10, 2009

I have a large dataset with 21 columns and 3000 rows, but to keep it simple, the data looks more or less like the first dataset in the attached excel file.

This results in 3 curves (time vs force). However, there is excess data in there, I only need data as soon as the Force becomes positive (>0) untill the Force drops below 0.02 again (I consider that the end-point of my curve). So, this dataset would look like the second set in the excel file after the macro-manipulation.

I think one of the difficulties is making sure that the macro doesn't cut of my data right in the beginning, when the curve first crosses 0.02. In that case, you get the last dataset. And this is not what I want...

I hope I explained my problem well, if not, please let me know.
So, is there anyone who knows how to do this?

By the way, is there anyway to insert small excel tables in this post? Cause I wasn't planning on having an attachment, but if I copy-paste the data in this post, than the formatting gets undone and it looks like there's no way to fix it...

View 6 Replies View Related

Reformat Time Data Into Decimal And Remove Excess Characters From Field

Feb 17, 2014

I have obtained the following data which I need to put into a spreadsheet to import into an accounts program. I can't change the way I get the data which is as follow

Hrs worked Rate
05:55:00£30.00/Hour
07:40:00£21.00/Hour
05:45:00£30.00/Hour

What I need to have is 5.92 30.00
7.67 21.00
5.75 30.00 ie the time format in decimal and loose all the unnecessary symbols etc for the rate

View 7 Replies View Related

Function That Sums The Values In A Range In Excess Of 2

Jan 14, 2009

I am trying to write a function that sums the values in a range in excess of 2. For example, if the cell is 3 add 1, if it is 5 add 3 etc.

Here is what i have so far, it compiles with no bugs, but it does not work in my worksheet. I wrote it in Sheet 1 (VBA) of the worksheet i am using it in.

View 2 Replies View Related

Remove Excess Characters In Cell Or Row Or Column

Dec 7, 2012

I have got a cell or cells with certain number of Characters (Alphabetical or Numeric or Alphanumeric). I would like to remove the excess Characters in the Cell from the end.

Example: If a cell contains 234 characters, Excess characters (More than 200) to be removed from the end.

Any formula or Vba program in generic form, so that i can limit the number of Characters to as required.

View 3 Replies View Related

Strip Excess Spaces Out Of Address Cell

Jan 31, 2008

I need VBA to remove more than 3 blank spaces after the city & replace them with a comma & one blank. For example:

All in one column AB starting with row 7 I have:

Johnson City (13 Blank Spaces) NC 75503 (1 to 3 spaces after state & is OK)
Jacksonville (10 blank spaces) Fl 23854
Henderson (12 blank spaces) NH 28363 (12 blank spaces)
etc

I need all in one column AC starting with row 7:
Johnson City, NC 75503 (,space before state, same space after state ok)
Jacksonville, FL 23854
Henderson, NH 28363
etc

View 9 Replies View Related

Cell Content > 255 Then Move "excess" To Row Below

Oct 1, 2009

I'm looking to combine a number of worksheets into a summary sheet .. but on some the narrative is more than the 255 characters. How can I , where this is the case, insert a row below.. say input "Continued" in column A and then copy the contents of the cell which is more than 255 to the cell immediately below it.. and maybe do this again where users input more than 510 characters.


Alternatively, is there a way of getting around the copy and paste values.. where it only inputs 255 ?

View 9 Replies View Related

Macro Inserts 3 Rows Below Each Existing Row Of Data And Copies And Pastes That Data Into Each Of The Empty Rows

Nov 30, 2009

need to create a macro that inserts 3 rows below each existing row of data and simply copies and pastes that data into each of the empty rows before moving on to the next unique row and doing the same thing again.

This is what I have so far, but I can't seem to get the loop right.

Rows("2:2").Select
Do
Selection.Insert Shift:=xlDown, CopyOrigin:=xlFormatFromLeftOrAbove
Selection.Insert Shift:=xlDown, CopyOrigin:=xlFormatFromLeftOrAbove
Selection.Insert Shift:=xlDown, CopyOrigin:=xlFormatFromLeftOrAbove

activecell.Offset(-1, 0).Select
Range(activecell, activecell.Offset(0, 5)).Copy
activecell.Offset(1, 0).PasteSpecial
activecell.Offset(1, 0).PasteSpecial
activecell.Offset(1, 0).PasteSpecial
Selection.Offset(1, 0).EntireRow.Select
Loop

View 5 Replies View Related

Excel 2013 :: Averaging Rows Of Data Within Larger Blocks Of Datasets - Skipping Rows

Jul 16, 2014

I am trying to average different rows and columns within a larger block data set in a series. This data is from a 96-well absorbance microplate reader experiment. I only mention this to describe the raw data output I am dealing with.

Each set of data is in a 12 x 8 block with the next block below it with one blank row between. So I have a block of data contained between A1->L1->L8. The next block is contained between A10->L10->L17. This continues for a total of 28 blocks.

I want to take averages from rows or columns from each block and autofill them into a single column. So for example I'll need =Average(A1-C1) with =Average(A10-C10) below it and so on and so forth. My problem is that if I try to autofill from this already started column the third row will take the average of A2-C2 instead of A19-C19.

Is there a formula/script for me to skip the correct number of rows to the next data block?

I have attached my spreadsheet to this thread. I am using Excel 2013

FeS_Kinetics.xlsx

View 1 Replies View Related

2 Rows Of Data For Individuals In A Population - Attempting To Average The Rows?

Apr 30, 2014

I am an undergraduate biology major working on a geometric morphometrics project. It is focusing on wing asymmetry, so I have data for the left and the right wings for a sample population of 30 individuals. The data from the software is exported as a spreadsheet with two rows of data for each individual, since each wing was calculated separately, and my mentor has asked me to average the data for subsequent analyses in another program.

I'd like to do this easily with an Excel formula, but when I try to do the averages I'm having a little trouble getting the formula to carry on correctly. I need it to average, say, E2:E3 then the next cell average E4:E5, but instead the only thing I can get it to do is average E2:E3 then the next cell do E3:E4. Which obviously doesn't work for me, since E3:E4 is data from two different individuals.

Is there a way I can do this for my data? One of my spreadsheets is a 60x32 matrix of landmark coordinates, so I'd really rather not try to do all the cells individually.

View 1 Replies View Related

Moving Data From Rows To Columns And Delete Repeated Rows

Apr 16, 2014

removing duplicate rows and move other data frm rows to columns.xlsx.

I am attaching a sample excel sheet showing what I need to do.In the first tab, I have a list that includes duplicate rows (first column only). I want to remove those duplicate rows but I don't want to lose the data in the following columns which can be unique or duplicates as well.

see the desired result tab in the sheet to get an idea of what I am looking for as the end result.

Keep in mind that the actual source file I am working with could have up to 50000 row, and the expected results could be around 2000 rows. So nothing can be done manually.

View 5 Replies View Related

How To Dynamically Insert Rows With Duplicate Data Of Previous Rows

Oct 30, 2013

I have a spread sheet with values in the area of A1:H834

In column H, I have number values from 1-7.

Essentially that number value means that the values in the row are duplicate.

So, for example, if H2 has a value of 4, that means that $A$2:$G$2, really should have an additional 3 rows underneath with the EXACT same data in each cell, however, the way the sheet was created, was to remove the duplicate values and just indicate in column H, the number value of how many duplicates $A$2:$G$2 really is.

I need to unpackage this and create what it was originally. What type of formula can I use, to look at the value in H2, and then insert underneath that number of rowes with the exact same data as A2:G2 and do the same for the remainder of the table all the way down to A834:G834

View 1 Replies View Related

Convert Rows With Repeating Data To Separate Rows

Aug 5, 2009

See the attached xls. There are two worksheets contained therein, one with the original data, and the other showing how I'd like it organized.

I have rows of product data consisting of a product id followed by repeating attributes of quantity and associated price. I need to convert each product row to multiple rows of each quantity/price pair while preserving the id for each pair.

View 10 Replies View Related

Fill In Empty Rows Below With Data From Rows Above Macro?

Oct 12, 2011

I have a worksheet with 40 colums and 9200 rows. There are columns with empty data in the rows. Can I have a macro to copy data in the rows in Column E, F, I, J K and L to empty rows below?

View 3 Replies View Related

Convert 1 Row Of Data To 4 Rows And Have It Repeat Every 4 Rows?

Jun 28, 2014

I have raw data stored in one row which I would like to break up into four individual rows.

I cannot get the formula to repeat and I don't want to manually do it.

View 3 Replies View Related

Combining Rows And Keeping Data From Both Rows

Mar 9, 2013

I have a game where people are scored on the spreadsheet, but they can join anytime, so everyday, I get a combined list of points. The list consists of people who joined previously, and the new players. How should I combine the points?

[URL] ..........

View 4 Replies View Related

Copy The Data From More Rows To Rows Above

Oct 1, 2009

I want copy the data from Rows 25-29 (B25:E29) to under Rows 20 (B20:E20) or Rows 21 and next rows, When I click this Button (New).

And then after copy the data, data in Rows 25-29 (B25:E29) will be deleted, And insert new row for the next data.

View 3 Replies View Related

Macro To Generate Outlook Emails With Data / Information From Multiple Rows Of Data?

Apr 30, 2014

I am attempting to create a macro to generate emails based on data in a sheet. The goal is to run the Macro, and have it generate emails to send to contractors letting them know what they are going to be paid. For instance:

Name in Column J
Email in Column L
Memo in Column N
Balance in Column T
Due Date in Column P
Week Ending Date in Column H

Now what I would like to happen, is to tie a macro into a button that will create the email as follows:

To Field: Email address from Column L
Subject: "Company Payment Remittance Payment Date *Date from Column P*"
Body: Hello *Name from Column J*,
For *WE Date in Column H* you will be paid *Balance from Column T* for the time worked of *Memo in Column N*

Now the tricky part is that I want the email to contain all line items for each email address. So instead of sending one email per line, have the macro automatically put all of the information that needs to be sent to one email address into the message. I don't know if that is possible, but it sure would make my life easier if it was.

I have attached a sample workbook of the data that will be used

Example Workbook for Email Macro.xlsx

View 1 Replies View Related

Macro To Clear Row Data Then Shift Remaining Data Up To Empty Rows?

Apr 15, 2014

I'd like to have a sheet with multiple columns of data (say A thru K for instance.). Id like to reserve column A for ONLY imputing an X. The rest of the columns b-K would have data in the cells. I'd like to have a macro that when it saw an X in column A, would copy all of the data in cells B-K in that row, paste it into the next empty row of a second sheet (for history tracking), then go back to the original sheet and continue looking for additional "X"'s and repeat. Once all of the X's were copied, it would "clear" (Not delete because some of the cells would have formulas in them that would need to remain for future use.) the cells based on the "X" then finally move all of the remaining data up to the empty rows to fill in the empty rows. This last piece would be more for esthetics to have a clean looking sheet.

View 1 Replies View Related

Userform - Retrieve Data From Excel Sheet And Overwrite With New Data In Same Rows?

Mar 3, 2014

I have created a userform with multipage, has two page that add new record in a excel sheet. Data has a unique reference no.(TxtRef.Value) for each record. I am trying to add a button to load the added data for a specific record using reference no back to userform so that it can be updated and overwrite back to the sheet in the same row, So far it is adding new record correctly. I do not know how to populate all the fields of the of an existing record and overwrite it back to the same row instead of adding a new record. Below is my codes

[Code].....

View 1 Replies View Related

Find The Data In Some Rows That Match With One Cell And Automatically Fill The Data

Aug 17, 2009

I want find the data in some rows that same with one or more cell and automatically fill the data. And for more details, I have attached the examp file (Examp.xls).Antoni

View 3 Replies View Related

Resample Data: Total Number Of Points Reduced By Averaging The Data Not By Simply Deleting One Of Every Four Rows

May 16, 2006

I have several files of data that are from a data logger. The data is broken up by day. Each day has roughly 43000 rows of data, at its sample rate. This has made charting the data a nuisance. Is there a way to resample the data so it fits in the 32000 points excel can chart? In the future I will set a sample rate that will keep the number of points below the 32K per series. I would like to be able to have the total number of points reduced by averaging the data not by simply deleting one of every four rows.

View 5 Replies View Related

Load Rows Data On Selection Of Data Validation List

May 28, 2014

I want to load the actual data exist in the rows by selection value from the data validation list.

E.g I have two worksheet in one excel file. One has a data activities of persons with their name like two columns i have in which one exist the name of person and second exist the activities which they perform.

On the second sheet, i made a data validation list of all the person names

Now my requirement is, when i select a person name from the list, load all the data from the 1st sheet to second sheet. Is this possible without VB code, because I want to share it on the Google sheet with my boss, where VB sheet is not supposed to work.

View 13 Replies View Related

Formula To Move Data On Same Row And Deleting Empty Rows Between Data

Jul 17, 2014

formula to make data on same line.On converting data2 is above data 1. I insert a column on left . Need to use mouse right click shortcut delete manually shift cells left and then delete shift cells upto have both data on same line but should be in different cells and same sequence per attached ALSO TO REMOVE "/ -DASH HYPENS.

What I need is formula to move the data2 on same alignment and to delete the two empty rows between both data.

See annexed file for expected results.I have preference to have a formula much more.

View 7 Replies View Related

Converting Horizontal Data To Vertical Data With Multiple Rows?

Sep 8, 2009

reformat a table in which data for each named person is presented in one row with mutiple columns into a table in which each named person has multiple rows and one column of data. The solution to to this has eluded me so far.

The attached example shows before and after.

View 6 Replies View Related

Rows Similar Data Divided By Blank Row To Delete Data If There Are 6 Or Less

Apr 2, 2014

I have a lot of rows of data all divided with an empty row and if they are 6 or less all rows need to be entirely deleted any 7 or above need to be kept.

View 2 Replies View Related

Transpose Or Convert Rows Of Data Into Columns Of Data:

Feb 12, 2009

When I was using Excel 2000, there was an Excel add-in where I could highlight rows of information and then transpose these into columns of information. Since we have upgraded to Excel 2003, the same Excel add-in does not work and I have not been able to find a simple solution to transpose my information from a horizontal view to a vertical view or the reverse.

Or do I just have to move 53 columns (weeks) of 4 rows one cell at a time to 4 columns of 53 rows (weeks)?

View 3 Replies View Related

Display Data By Criteria Has Multiple Rows Of Data

Mar 10, 2009

Need in displaying data by user input criteria, mulitple rows of display also need to display to blank out when no criteria is input. In example spreadsheet the criteria cell is B6 in "Results" page and needs to pull in data from the "Database" page.

View 3 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved