Finding First Non-numeric Cell

Sub Test2()
'From the top down
If IsEmpty(Range("A1")) Then
Range("A1").Select
Else
Range("A1").End(xlDown).Offset(1, 0).Select
End If
End Sub

I would like to change this to find the first non-numeric cell (technically the column i'm searching is dates, but i assume those are seen as being numerical). I tried to change this line:

If IsEmpty(Range("A1")) Then
TO
If IsNumeric(Range("A1")) Then

But as many of you know it didn't work (i also tried variations of IsNumeric(Range("A1")).Value=True