Delete Records In Set After Classification?

May 23, 2014

I have a large (300K+ records) database with a sizeable amount of duplicate records. I want to delete the duplicates but this is not a matter of simply Remove Duplicates; I need to evaluate them before I do.

I am wondering what functions would:

1) select the specific record in a set of duplicates that makes a determination of a status
2) once the status has been determined for the set, delete all other records

Fields in my database:

ACCIDENT NUM (ID field, in text or General format)
DUP (for Duplicate, indicated by a character, for now its a "?")
OCC_KILLED (in Number format)
OCC_INJURED (in Number format)
SEVERITY (in text format)

Here are some scenarios:

ACC dup K I
12345 ? 0 0
12345 ? 1 2

Or:

ACC dup K I
123456 ? 0 1
123456 ? 1 0

Or:

ACC dup K I
1234567 ? 0 0
1234567 ? 0 2
1234567 ? 0 0

This is the formula for indicating if there are Duplicate records in the larger dataset:

=IF(OR(A2=A3,A2=A1),"?","")

I need to determine the Severity of the accident based on this:

If OCC_KILLED > 0 then SEVERITY = F (for Fatal)
IF OCC_INJURED > 0 and > OCC_KILLED then SEVERITY = I (for Injury)
IF OCC_KILLED and OCC_INJURED >= 0 then SEVERITY = F
IF OCC_KILLED and OCC_INJURED = 0 then SEVERITY = PDO (for Property Damage Only)

I have a code already in place for how to create the value for Severity but it DOES NOT account for duplicate records:

(in SEVERITY field):

=IF(A1<>0, "F",IF(B1<>0,"I","PDO")

sampleset.xls is a sample ot the database.

View 10 Replies


ADVERTISEMENT

Clustering/Classification Using Excel

Feb 21, 2009

I am trying to do clustering/classification using the shortest euclidean distance. In the attached Excel spreadsheet, I am trying to classify new visits in Table 2 into one of the three visits given in Table 1. I have calculated the euclidean distance in Table 3 and classified them into one of the three visits.

The issue I have is that the number of columns in the original data is more than 100 and I don't want to do the euclidean distance for each column (square the difference for each columns and add them) separately. Is there any efficient way to do this classification?

View 9 Replies View Related

Transferring Data From One Sheet To Another Via Classification?

Jan 15, 2014

I'm not sure that this is possible without VBA, but here goes.. My sample workbook has 3 sheets. 'Master' Sheet A contains fields that are to be completed manually as our sales people talk to prospective customers. Once that information has been input, I'm trying to find a way to have the contact information (columns B - L) to copy automatically to either (in this example) to sheets B or C depending upon the chosen category in Column A, Sheet A. An example is that the sales adviser inputs the information into sheet A and then gives each row of information a category, say B, which then copies the required fields into Sheet B, at the next available row.

View 4 Replies View Related

How To Filter And Delete Records

Jan 20, 2014

I am new to to VB Scripting, filter the records. In the attached file there are multiple records which needs to be filtered. Once all the records are filtered, i want to delete the entire row of that record(s). I want to filter column 'F' with the values mentioned in Sheet2. I tried recording a macro, but it is not allowing me to do so as the macro has some limitations. The search and delete row loop The main purpose is to delete the row of the value, if not found, move on to next value in Sheet2.

View 4 Replies View Related

Delete Duplicate Records

Jul 15, 2009

I have a spreadsheet with a column of records (text ) from B1:B4000. I would like to delete the entire row of the duplicate record. Overall data set range is (A1:I4000). This spreadsheet may contain more than 1 duplicate record. Is there in easy fix?

View 12 Replies View Related

Delete Of Duplicate Records

Nov 22, 2009

I'm having trouble getting this piece of macro to work. I want to delete duplicate Id records in (Cell B12 : B124), but only those with "No" in the (Cell Z12 : Z124) will be deleted.

Table
B12 Z12
-------------
E1 Yes
E2 Yes
E3 Yes
E4 Yes
E1 No
E2 No
E3 No
E4 No

Expected results:
E1 Yes
E2 Yes
E3 Yes
E4 Yes

View 13 Replies View Related

Delete Records From Spreadsheet

Jun 29, 2009

I have some data that looks like this.

No. Date
1519
1519 06/17/2003
1601
1652 06/30/2005
1652
1705
1705

What I would like to do is delete all numbers including those with duplicates that have a date of 2004 or sooner. In otherwords, anything from 12/31/2003 and later I want to keep, but anything from 01/01/2004 until the present.

View 9 Replies View Related

ADO Delete Database Records

Dec 21, 2006

I'm creating an Excel UserForm where the user can view, edit, and delete records they've entered.

The following code is for Deleting a selected record, and it IS WORKING. But it seems TOO SIMPLE and I want to be sure it's correct and not leaving any loose ends in the Database file that could cause corruption later on....

Sub vCLdbDel()
Dim cnt As ADODB.Connection

Dim dbPath, dbName As String
Dim stSQLAs String
Dim stCon As String
Dim dbid As Long

Run "setvars"

'Get the dbID from the selected Item in the list
With vCL.CLdbList
dbid = .List(.ListIndex, 6)
End With

'Path & FileName to the Database File
dbPath = M. Range("G2").Value
dbName = M.Range("G3").Value

View 7 Replies View Related

Count The Number Of People Per Classification Between Two Dates

Apr 21, 2014

Count people per their classification between two dates. Spreadsheet attached.

The answer I need to show in column (S) is:
Cell (S4) = 1 (supervisor)
Cell (S24) = 1 (fitter)
Cell (S36) = 3 (rigger)
j906 count.xlsx

View 1 Replies View Related

Delete Records When Cell In E Is 0 Or Blank?

Oct 31, 2008

I d like to find a method with which I can delete records from E starting from E2 that have 0 or even blanks with a macro.

View 9 Replies View Related

Auto Delete Records In Excel?

Mar 23, 2012

how to automatically complete with Excel the following task:

1. I have two email databases in Excel: a master database and opt-out database.

2. I need to remove from the Master database emails of opted-out people.

3. Since the databases are large, I'd like to use a relevant Excel function to do that automatically.:

In the master list (column B) I have all the emails from the Master list. I have copied in the column C of the Master list the emails of all who opted-out. I need to remove opted out emails (listed in column C) from the master email list (column B).

View 1 Replies View Related

VBA To Delete Records Based On Certain Date

Jul 18, 2012

I have a spreadsheet titled "PMIX" In Columns A:F Column F has Week Ending date. Each week, I need to update this, i.e. delete the data from two weeks ago and then add the new weeks data. What I am thinking is I enter a Week Ending Date in H1, then I would like VBA to delete all rows where it has the data in H1. I am hoping for a delete function as opposed to a clear so I can shift all the rows up.

View 3 Replies View Related

Delete Records When A Cell In E Is 0 Or Blank

Oct 31, 2008

I d like to find a method with which I can delete records from E starting from E2 that have 0 or even blanks with a macro.

View 9 Replies View Related

Delete All Records Below A Variable Row Which I Select Highlighted

Mar 1, 2009

1. Is there a way to delete all records below a variable row which I select highlighted ?

2. I have a spread sheet which is located in the folder xl start. How can i find this file to delete it>

View 5 Replies View Related

Adding Search Function To Delete Matching Records..

Jun 1, 2009

I'd like to do is click the delete button and when clicked, it will search for matching records in column A & B and if they match... I'm thinking the code for that is <> but I'm not sure, then delete that record, and shift the cells up. Do this until the search results are empty below the delete button. Like I said, it's probably more understandable to look at the workbook.

View 5 Replies View Related

Macro - Find Null Cells And Delete Records

Oct 3, 2013

Creating a macro. Need to delete records in column D from the first blank cell. 1st blank cell variable.

View 9 Replies View Related

Find Duplicate Records Based On Multiple Columns But Keep Records

Aug 10, 2014

I have a range of columns i.e. 23 columns (i.e. B through X). Someone can write records in these columns (starting from B21).

Duplicates are considered the rows with similar data in columns 3 and 11. I know about the removeduplicate method and works really well but i want the duplicates not to be removed. Instead another column shall be checked for date of entry (user will entry date in format dd/mm/yyyy). The newest entry will change the value of the cell in column 4 (islatest column)to TRUE while all other records will be FALSE. This will work with the filtering of data on a pivot table on another worksheet.

View 7 Replies View Related

VBA To Rearrange 11000 Records Into 550 Rows (20 Records Combined Into Single Row)

Apr 25, 2014

Book1 and Book2 are workbooks that I have modified in order to protect private information.

Book1 will have 11,000 records (my example Book1 has only 100). I need to rearrange Book1 such that it looks like Book2. Book2 has 20 complete records from Book1 combined into one single row, and my example Book2 has populated 3 rows only (3 rows x 20 records, making 60 records now appear on 3 rows only).

Macro for getting Book1 to Book2? 11,000 records in Book1 will take a lot of hours to transform into Book2 unless a macro can do the job for me.

Book1.xls
Book2.xls

View 5 Replies View Related

Userform Database: List Records In A Sheet As Well As Search For Records In A Sheet

May 7, 2006

example of a database user form that will allow me to list records in a sheet as well as search for records in a sheet. I know excel has a built in feature for this but it is menu driven and I need something that is button driven and will allow me to resize the form layout. I was not able to figure out how to do that with the built in form.

View 7 Replies View Related

Getting Records With MAX Value?

Jun 6, 2013

I have a dataset with 5 columns. i want to identify the the max users in each zip code and the corresponding ID for it. For e.g. for zip 01105, max users are 1380 for ID 010840. I want my final data to have just these 3 values.

I tried the pivot table but it hides the ID corresponding to the MAX value.

ID Zip CityState Users
01084001105SpringfieldMA1380
01012001105SpringfieldMA1102
01003001105SpringfieldMA518
01145001105SpringfieldMA27
01384001105SpringfieldMA3
01084001107SpringfieldMA629

[code].....

View 2 Replies View Related

Getting Top 10 Records From A Range

Jun 17, 2014

I am looking for a formula to give me the top10 records from a range.

Please take a look : Top_10.xlsx‎

View 6 Replies View Related

To Count Records If Value = 1 Or 2

Jan 9, 2007

creating a formula to count the number of rows in a different worksheet if a cell has a value of "1" or "2" (these are the only two allowed values) AND a status of "'on track". also need to add values in other cells within the different worksheet if the value is "1" or "2" AND has a status of "on Track".

View 9 Replies View Related

Combining Records Together

Oct 25, 2008

I have a problem in excel that is very urgent to resolve. I have a table that contains duplicate records e.g two people living at same address. I want to merge those records whose address field value is same. Find attached an excel sheet that contains the exact data and the exact output that I want. I know it requires VBA coding.

View 4 Replies View Related

Look Up For Matching Records

Jul 30, 2009

i have cell N1 witch is a number example "8832"
cell O1 is text example "state street"
now i have A1 thur A10 as an address "number"
now E1 thur E10 is street address "text"
i need to take n1 match it to A1-A10
then take that row number and see if E1 of that row numbers matches
O1 if it does that that row numer and get g of that number if not keep checking to i find a match

View 6 Replies View Related

VBA Code That Records The Changes

Aug 26, 2009

I have 2 workbooks Mater and Update. I have a VBA code that compare between the two files column by column and update the Master file according to the Update file ( the code below).

Now my user want to see in a separate worksheet ("changes") only the changes - Date and time of changes at column A , old value at column B and new value at column C ........

View 9 Replies View Related

Count Records In Row

Aug 26, 2009

I need to count how many rows of records there are on the page labelled Data.

this is what i wrote...

=COUNT(Data!A3:A1995)

doesn't seem to be working correctly

View 2 Replies View Related

Updating Records

Jun 10, 2009

I am using Excel 2007.

I have a large spreadsheet and new data is added periodically.

I have several columns of data associated with a description & date.

The data associated with each description is unique to that day.

I want to archive the older desciption data after I add newer description data.

Column B = date of the data
Column E = description (phrase)

How do I remove duplicate older rows of description data from my main spreadsheet (keep the newest descriptions rows) and save the older rows of data in a archive sheet?

My sheet has many columns from A to BU.

I have about 220,000 records with many duplicate Descriptions in column E. Each Description record has a date in the Date column B.

Records are sorted by: Description A to Z
then by: Date Newest to Oldest.

Here is an example (not actual sheet):

I highlighted the duplicate Description records in these examples that I want to update and archive.

I want to delete the older Description records from my main sheet so that only the duplicate Description records with the newest date remains like the example below.

And the older duplicate records that are removed from the main sheet I would like to save to a new sheet so that I can save a history of the Description records.

View 11 Replies View Related

Matching Records With VBA

Jul 11, 2006

I have 2 worksheets. Sheet 1 has in column B a single ID number in every cell, Sheet 2 in column A can have multiple numbers in a cell (e.g. "55517 / 55518 /55519" written in one cell.)

For every row in Sheet 1, I need to find the ID in Sheet 2 and add in column C in Sheet 2 the corresponding cell value found in column E on Sheet 1.

By doing this formula, when I am in Sheet 1, I can already find the row number in Sheet 2, if it exists.

=IF(ISERROR(MATCH("*"&B2&"*",Sheet2!A:A,0)),IF(ISERROR(MATCH(VALUE(B2),Sheet2!A:A,0)),"NONE",MATCH(VALUE(B2),Sheet2!A:A,0)),MATCH("*"&B2&"*",Sheet2!A:A,0))

I suppose I can then move to the destination cell by using OFFSET.

This is all I have been able to figure out conceptually.

I think it makes more sense for this to be in VBA. Especially the 'writing part' I don't know how to do. After the OFFSET part, how do you tell Excel to write something to that cell?

Because several IDs from Sheet 1 can occur in Sheet 2, it would have to add like REPLACE at the end (ie. len(cell)) "+result", so they get summed if there are multiple finds.

I am also not sure the MATCH sentence above can be translated as a Macro, or whether it is even an efficient way.

And finally, it has to loop (repeat for every row in Sheet 1), which must require VBA.

View 9 Replies View Related

Change All Records With Same Corresponding Value

May 20, 2008

I've a worksheet with a list of destinations and country code as well as Y/N fields.
I want to create a solution such that when I change the yes/no field for one destination, all other destinations with the same country code will follow.
I have attached my work file below.

View 6 Replies View Related

Userform To Add / Edit Records

May 1, 2013

I've been trying to resolve an issue with the userform that i created. It adds new records to the sheet "Data" but i can't seem to add a search/edit function to it.

It could be either a combobox with the existing Project Id's or a text box + a control button, so a user could enter Project Id and hit a button.

The spreadsheet example is attached : Project Entry Form.xls

View 9 Replies View Related







Copyrights 2005-15 www.BigResource.com, All rights reserved