efficient way to process data

[Larry Martell]

On Mon, Jan 13, 2014 at 11:32 AM, Chris Angelico <rosuav at gmail.com> wrote:
> On Tue, Jan 14, 2014 at 5:27 AM, Larry Martell <larry.martell at gmail.com> wrote:
>> Thanks. Unfortunately this has been made a low priority task and I've
>> been put on to something else (I hate when they do that).
>
> Ugh, I know that feeling all too well! Life's better when you're
> unemployed, and you can choose the interesting problems to work on.
> Apart from the "has to be in MySQL" restriction (dodged now that the
> work's all being done in Python anyway), yours is _definitely_ an
> interesting problem.

if you're interested in what the application is, this is data
collected with an electron microscope from semiconductor wafers as
they are being manufactured. The x and y are the position on the wafer
that the data was collected, in microns. If 2 data points are
collected within 1 micron of each other they need to be combined when
being analyzed.