Excel 2007 :: Transposing Large Amounts Of Data

Nov 30, 2010

I have data that as 872 columns - each representing a question ID (headers in the first row). I then have 1494 rows of data where each represents 1 unique person. In other words, A2 = Person ID and B2-AGN2=the potential answers to the questions.

What I'd like to do is compact this into 3 columns: "Person ID", "Question", "Answer".

"Person ID" will have duplicate values for each question that is answered.
"Question" is the Question Text
"Answer" is each answer to each of the questions.

So in a condensed form, my data looks like this:

ID Q1 Q2 Q3 QAge
3 1 5 8 35
4 1 2 12 64

And I would like it to look like this:

ID Question Answer
3 Q1 1
3 Q2 5
3 Q3 8
3 QAge 64
4 Q1 1

etc.

It would be fantastic if Excel has the functionality to ignore null answers and therefore just not even bother populating Question ID when an Answer is blank (e.g. they didn't report an age, so QAge doesn't show up under the new "Question" field), but I have no idea if that's doable.

I have a lot of datasets like this with a varied number of rows and columns, so any way to adjust whatever formula/macro is out there to work for those. I'm terribly new with macros and so I've been having difficulty adapting them if I need to.

I'm using Excel 2007.

View 10 Replies


ADVERTISEMENT

Sorting And Counting Large Amounts Of Data

Jan 1, 2009

want to be able to take a large quantity of data, sort all the like data together, and then quantify the number of each like data. I need the equations to do that.

View 11 Replies View Related

Functional Way To Break Up Very Large Amounts Of Data

Mar 28, 2012

I am looking for a functional way to break up very large amounts of data. I am looking to break them up by an ID number and then by date. The date function needs to break up data from a hire date to the closest date to a year without going over and proceed to do that for multiple years. I am hoping that the function can just add a blank row between the split data. The file that I have not comatins three years.

View 1 Replies View Related

Pivot Table For Large Amounts Of Data

Apr 7, 2007

if there was a way I can put it in to some kind of pivot table, because the hardest part for people when they read his list is it's so large it's hard to find data easily.

So this is how he formatted his data... I was wondering what would be the best way to get this list in to a possible pivot table. This is a consilidated example, there are plenty more columns, but this will give you an idea of my problem.

A2007 A2006 A2006 B2006 B2006 B2007
Feb Jan Feb Jan Feb Jan
630 Labor Cost 1000 7500 3000 4500 800 5000
624 Equipment Cost 900 50 40 300 20 1400

Now, the only thing I can think of is to make columns, but then I'd have to recopy all the task names (which there is about 700) for each of the different years (A= Actual, B= Budget, F= Forecast). Is there any other way that you can think of to do this with out making it so complicated? Any help or suggestions would be great. I really want some format that allows you to click the total and it goes to what makes up that total.

View 7 Replies View Related

Transfering Large Amounts Of Autofiltered Data To New Worksheet

Feb 10, 2009

I have a problem with my current macro that uses a basic autofilter to auto filter from the parent database to extract the correct rows and then copies the query and pastes it into a new worksheet to further proceed with the macro.

I have run into a problem because my database has become very big and now when I try to autofilter the query and click on copy, an error regarding the data range reference is too complex - use data that can be selected in one contiguous rectangle

I tried a few things such as to autofilter out everything I dont need and hit delete - this does not work either, same result

I got help here previously in which the code deletes All Hidden Rows and this is very time consuming, I have not tested all my methods but it took 15 minutes to delete hidden files for one method and theres roughly 5 in total

I have to end up running this code on the parent worksheet multiple times because I use the parent worksheet to extract different parameters into different worksheets!

I have noticed that if I manually copy the data in smaller blocks, by halving the data seems to work,but I do not know how large of a partition I am limited to copy because my database is very large and the size varies month-to-month so I cannot put a number on the max range. I think if I could get a macro to do it by thirds or preferably quarter range should be safe.

So just to summarize, I am trying to devise a method in which I would auto filter on the active parent sheet "sheet 1" and I would copy the auto-filtered query to "sheet2" instead of copying the whole worksheet in one instance I would like to split the autofitlered query into four equal parts with respect to the range of the worksheet and then to copy the first quarter of the query and paste in sheet 2 and then the second quarter to sheet 2 and so on untill all four quarters are done one after the other, so sheet 2 should be a series of all four parts combined into one series on sheet2

View 9 Replies View Related

Clipboard - Copying Large Amounts Of Data From One Full Sheet In One Workbook To Another

Sep 6, 2007

I'm copying large amounts of data from one full sheet in one workbook to the sheet in another book.

Everything is now automated, except that it asks in between books if I need to keep the Clipboard data.

View 5 Replies View Related

Excel 2007 :: Transposing Many Rows And Columns To One Single Column

Oct 22, 2013

I am trying to reformat the attached doc into one single column, It's a race listing of overseas marathons and I need it to look like this

Event Name
Event Date
City
Country
Entry fee
Website

in date order, one event after the other in a single column so I can flow it into a word doc ready to be designed. I need to apply in Excel (I am using 2007) to get this doc into the required format?!!

View 5 Replies View Related

Excel 2007 :: Handling Large Number Of Records

Jul 10, 2013

I have various month's data - forex tick data - each month has between 12 and 14 million records and comes down as a .csv file.

I would like to analyse the data in Excel

How I can breakup the huge .csv file into manageable excel parts?

View 3 Replies View Related

Excel 2007 :: Locate A Chart In Large Spreadsheet?

Nov 16, 2011

I have inherited a series of Word reports containing links to charts in several Excel files. I can tell by the link in Word that one of the charts is named 'Chart 6'. Is there an easy way to locate which chart in the Excel file is 'Chart 6' (and on and on for all of the other charts linked in the Word doc)? There are upwards of 21 charts in each Excel file linked to each of the Word reports. I am using 2007 but the files are in 2003 format because of limitations of the program from which the data comes for the charts.

View 4 Replies View Related

Excel 2007 :: Make Column Headings Appear On Large Spreadsheet?

Sep 7, 2012

How do I make the column headings appear when I'm working on a large spread sheet so I don't have to scroll to the top each time to see where I am. This is on Excel 2007.

View 5 Replies View Related

Reorganizing And Transposing Data Through Excel Macro

Oct 13, 2012

Reorganizing data, that would probably be best achieved with a macro. I've attached a file that represents my situation fairly well. There are 2 tabs, an Input and Output tab.

The input tab has Names along the left side, that may change in number frequently. Then along the top I have metrics, and values corresponding to the names. What I need a macro to do is to basically create an "entry" in the Output tab for each value.

The output tab is in a specific order, but basically there are 8 columns. The 4 unspecified columns don't need to be filled. The other 4 represent data from the input tab. The "Metric Value" can simply be filled with 0s for now.

Excel - VBA Assistance.xlsx

View 5 Replies View Related

Excel Not Showing 0 Amounts As Data Label In Charts

Feb 17, 2009

I am building automated solutions where graphs source data is based on outcome of formulas. In case of line graphs I use #N/A as result if no data is available or formula results into an error - this way the data point and data label will not be shown in the graph.

However this does not work for bar graphs - with #N/A, #DIV/0, 0 or "" the bar itself is not shown but the data label is shown (as #N/A or 0). How can I set-up my formulas so that if result is 0 or formula is in error that the graph does not display the data label.

Attached excel file shows same data in 2 charts - 1 line chart (=OK) and 1 bar chart (=not ok). The data for chart is pulled from 2 other tabs (week&month) and merged into 1 data source for graphs.

View 6 Replies View Related

Excel 2010 :: Transposing Data With Blank Rows In Columns

Feb 10, 2014

We utilize large data sheets that can be as large as 300K in rows and 10 to 15 columns wide. Because of how we receive the data, we are forced to manipulate things so that all matching data for a record ends up on a single row. (e.g. Record#, Document Type, Husband Name, Wife Name, Wife Maiden Name, Etc.)

Right now here's how the data is received:

a
a
a
b
b
c
c
c
c
d
d
d
e
e
e
e

Using two vba scripts, we first separate the data with row spaces between the unique data as follows:

a
a
a

b
b

c
c
c
c

Then with another script, we transpose the data as follows:

a a a
b b
c c c c
d d d
e e e e

When we transpose the data, the end result starts at the top of the page and go down eliminating the original blank rows. Not a huge issue but I would like to be able to maintain the original data format of the rows so that the data matches the original sheet line for line. The end result would give me the data as follows...

a a a
b b
c c c c
d d d
e e e e e

where the vertical gaps between the letters matches the original rows. Like I said, not a huge issue since we can rejoin the transposed data to the original data fairly easily. But it would be nice if we could end up with the above format for speed sake.

The two scripts we use, one-to insert the rows and two-to transpose, take a very long time to run with the transpose script taking the longest by far. On a 30K row sheet, it will take on our systems around 30 minutes to transpose and about 15 minutes to insert rows. Because we have several columns that need to be transposed, a 30K row sheet will take at least 2 hours to complete. A 300K row sheet, that will take 10 to 15 hours to complete.

Is there any way to speed up the scripts either by upgrading to a faster CPU and or writing the scripts to preform faster?

My preferred solution would be to write (have) a formula to preform the transposition that gives me the results as noted above since formula's run so much faster than vba. Is this possible? I have tried all kinds of formulas and can not come close and of course the straight transpose function does not give me the solution I need as noted above.

I have enclosed an excel 2010 spreadsheet with 10K rows of data in rows along with the scripts I use (nothing sensitive here). The tabs at the bottom shows you the data before I transpose, then the data after it has been transposed . To speed up the scripts, I have stripped away the all the rest of the data from the original sheet except just what I need to transpose at one time. Once that is completed, we then re-join the transposed data with the original sheet. The six digit number you see to the far left of the data is the record ID number from the original data. We use this to rejoin the transposed data with the original data so that we know everything is back where it should be. (Note: The insert rows script is run on the original data and not the data you see on the enclosed spreadsheet. That is the only way we can generate unique rows with matching ID numbers. We arrive at this by taking the original data, concatenate the record ID with the column we want to transpose and add a # between the two so that we can break things back apart after the transposition using the text to column function using the # as the separator.)

The sheet I have attached is in the 2010 Macro Enabled format...(xlsm format). We use the xlsb (binary) format for the data to reduce the file size as our normal procedure and run the macros from inside that format. Changing from the xlsx to xlsb format did seem to speed up the scripts a bit and greatly improved the file performance as a whole e.g. saving and loading.

One thing I have done to speed up the scripts is to strip all the data away that is not needed for the transposition. That did work but only a marginal amount.

We are using windows 8.0 with 4G memory and your basic processor speed...e.g. nothing fancy.....just your basic stock computer. Nothing else unusual is installed or running on the computer or at the time the scripts are running.

For those of you that process large sheets, how much of a performance upgrade will we see in processing our scripts by either upgrading memory to 8G (or more or much more) and or getting a faster processor? Or have we reached the maximum script speed already? Or is this a limit to Excel.

One other issue to note: As I stated above, on the 30K row sheets, not a super problem with about 2 hours needed to run the scripts on all the data on the sheet. But on the 300K row sheets, it can take 12 or more hours to run and there are times when things 'lock up' running the scripts on sheets this size.

View 5 Replies View Related

Excel 2010 :: Extracting Data From Large Spreadsheet

Jan 31, 2014

I work with Excel 2010 and have a very large spreadsheet with data that I need to manipulate in several different ways. I have been filtering and then cutting and pasting but this is very time consuming . Is there a way to extract specific data from the spreadsheet and transfer it to different worksheets? I don't really know how to use macros.

[URL] .....

View 14 Replies View Related

Excel Formula Retrieving Data From Very Large Dataset

Jan 17, 2013

I've been unsuccessful in trying to write a formula that retrieves a single result based on two criteria (from a large set of data on a separate worksheet). I've tried various INDEX MATCH combinations but no luck.

A
B
C
D
E

1
DATE
TEAM
PITCHERS
RESULT

2
4/1
nyy
Sabathia
???????

[Code] ........

So this is a very simplified version of my real data set which is about 20 times this size. The first worksheet is where I want to store my retrieved results (lets say D2 for example). I want to retrieve data from the second worksheet that matches two criteria (exactly) originating from my first worksheet. The two criteria to be matched from the first worksheet are, for example, A1 (sabathia) and F2 (the date 4/8). The complicated part is the desired result should be from the corresponding K/9 column in the second sheet, which in this case (based on sabathia and 4/8 criteria) is I2 (result would be 3). It's complicated since I can't just tell the formula to look down a specific K/9 column, I need to search ALL the K/9 columns in the sheet (of which there are many). Is this even possible with some sort of nested INDEX MATCH? Any possibilities outside of VBA programming, or is that the only way?

View 8 Replies View Related

Excel 2003 :: Column Function Insert Within Large Amount Of Data

Nov 27, 2012

I am trying to insert three columns within a large amount of data. I am using Excel 2003 edition. The three columns need to measure max, min, and standard deviation of month long ranges and the data goes all the way back to 1993.

Currently, I have a column that has the correct ranges but finds the average for each month

(=AVERAGE($H7214:$H7243))...

And many more ranges as it dates back all the way to '93. Is there a possible way to insert these three columns with their respective commands (=MAX... =MIN... etc.) while keeping all the ranges from the AVERAGE column.

In effect, I am looking to solely switch the begining of the column command

(=AVERAGE($H7214:$H7243)) to (=MIN($H7214:$H7243) etc...

While keeping all of the specified ranges from the AVERAGE column.

View 2 Replies View Related

Excel 2003 :: Formula Using Dates To Calculate Amounts?

Nov 22, 2011

I'm using Excel 2003 & Windows XP Professional.

I have two sets of data tables. One contains Number, Name & Date. The other contains amounts which those people have paid in 2007, 2008, 2009 & 2010. So in the below Jones has paid a total of $580 over those years, Smith has paid a total of $650 over those dates & so on.

The amounts in 2007, 2008 etc are full year amounts. I'm after a formula that can calculate the amounts for part years based on the dates from C1 to C11 by number (or name).

I've got what I think the results should be (I think with some rounding problems), but my real data has much more data.

View 3 Replies View Related

Formula Not Working On Large Number Of Records (500,000) - 2007

Nov 2, 2009

I am trying to use a simple formula: COUNTIF($CT$2:$CT:$430749,CT2)

I am trying to fill this down all the rows (430,749 rows). The formula behaves as its supposed to up to around row 650. After this point, all resulting values are all the same, which happens to be the same value that was returned from the original formula in C2. However, this is not correct. It's like the formula just stops working after row ~650. I tried F9 without success.

View 9 Replies View Related

Transposing The Data

Aug 7, 2009

I have a user form which I would like info entered into various text boxes to be assembled in a way which can be copy and pasted. See the attached example to see the results I am looking for.

View 2 Replies View Related

Transposing A Data Set

Nov 18, 2009

I have been trying to transpose a data set. Transpose formula is not working with this data set. How should i proceed ?.

View 4 Replies View Related

Transposing Data...again In Another Dataset

Dec 19, 2009

I was recently helped very much by the forum moderator and code from D_Rennie in a file to transpose about 25,000 rows into a few organized columns. The code worked very well. I have a slightly new twist on the problem. I have uploaded a different file with a different data structure in the columns but the same need for the data to be transposed to the columns under the same headings. This VBA worked very well before, but I can't seem to re-use it for this new dataset.

View 8 Replies View Related

Sorting Data And Then Transposing It?

Dec 20, 2011

I have a set of chemicals from groundwater tests at various wells. I need to sort the data, but chemical names can prove to be frustrating, since often times numbers or letters are found before the chemical name. Essentially, I'm trying to sort like this example:

Further complicating things is that at the end there's a (m,p-Xylene) and (o-Xylene) thrown into the mix.

Is there an easy way to do this sort? I imagine I'll have to have some sort of reference list that the sorting looks to?

After I sort it and do some data manipulation, I have a macro that transposes the data like the example below:

Here's the macro:

Sub Step4_ReorgData()
Dim w1 As Worksheet, wR As Worksheet
Dim c As Range, LR As Long, NR As Long, NC As Long
Application.ScreenUpdating = False

[Code].....

View 9 Replies View Related

Looking Up Data And Transposing It In Array?

Jul 14, 2014

I have two columns of data of which I need to transpose into rows. Sounds easy enough but the data looks like the following:

Business Role
Person
Accounts Payable Voucher Reviewer
SMITH,JOHN

[Code].....

I have read some sites talking about index and column or using VBA.

View 6 Replies View Related

Transposing Data For Graph

Jan 17, 2010

I am trying to create a graph for each store in my data sheet.

I have a data sheet with a list of stores that lists the quantity that was ordered by each store for the month of December. Not all stores placed ordered on the same dates.

What I would like to do is take the data from store line and create three columns that are: ....

View 11 Replies View Related

Transposing Data For Import

Oct 25, 2006

I need to transpose some data for import into our accounts package, the budgets are produced in a fairly standard horizontal format with periods across the top & account codes vertically.

The import requires period data to be be transposed vertically

I have attached a worksheet with an example, is this possible in excel. the only way I have managed to accomplish this is via MS Access

View 8 Replies View Related

Merging Similar Data And Amounts

Feb 22, 2013

Column A: List of document numbers
Column B: List of amounts

A B
111 $5.00
222 $10.00
111 $5.00
222 $15.00

I need to merge all equal document numbers so that it shows the full amount on that document number. It needs look like this in the end:

A B
111 $10.00
222 $25.00

I realize a pivot table will do this but the formatting of a pivot table will not work with what I am ultimately trying to do.

View 7 Replies View Related

Transposing Relevant Data Between Sheets

Jan 27, 2014

I've taken part of our instrument service data and eventually want to trend the performance but have decided it will only useful to use data where I have 4 or more data points. However with so much data I want to automate the process rather than scrolling through the column. I assume this requires a lookup table of sorts but I don't know how to combine that and getting the other bits of relevant information (I.e. all dates and results).

GavInstrument Spec data.xlsx

View 1 Replies View Related

Transposing Data For Duplicate Cells?

May 8, 2014

I have a sheet of over 20,000 rows, each with 2 columns. Column A is numerical, Column B is name and address. There are duplicate entries in Column B, but Column A has unique entries.

I need to have 1 row per unique name and address with the numerical data from Column A relevant to that name and address either in one cell comma separated, or in cell C,D,E,F etc...

View 1 Replies View Related

Transposing Data From Rows To Columns

Jul 8, 2013

I have a piece of equipment that I use for temperature profiling temperature controlled chambers. The equipment has up to 16 channels for logging data, although we typically only use 9. The data output from the equipment is by Text file and we convert this to Excel for manipulation into a format that can be issued as a certificate.

The test file outputs the data mainly in a single column and similarly when it is converted to excel the data remains in a single column. To enable us to present the data in a format that is presentable as a certificate we most transpose the data from each channel from a single column into an individual columns for each channel. Because I have limited knowledge of Excel, this operation is very time consuming and I'm sure there must be a quicker way to perform this operation in Excel.

I have attached a copy of the text file and the resulting Excel file with the data in it's original format and also in the final format. This is only a snapshot of the data over 30 minutes and we normally carry out measurements over 24 hours.

View 7 Replies View Related

Extracting / Transposing Sheet Data?

Mar 9, 2014

I have the attached file with two worksheets D30(1) and Sheet 2.

I need to extract some of the information contained on the D30(1) sheet into the format as contained on Sheet 2. It is almost like a transpose but because all of the information is not needed and all cells don't have info in it, I didn't even try to transpose the D30(1) info.

Is there an easy way to extract the information from sheet D30(1) to present it in the format of Sheet 2? I need to do this for approximately 50 sheets similar to D30(1). Some sheets might even have more columns than the example provided.

View 4 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved