Go Back   Science Forums Biology Forum Molecular Biology Forum Physics Chemistry Forum > Molecular Research Topics Forum > Animal and Molecular Model Systems > Botany Forum
Register Search Today's Posts Mark Forums Read

Botany Forum Botany Forum


Computerized plant image recognition program

Computerized plant image recognition program - Botany Forum

Computerized plant image recognition program - Botany Forum


Reply
 
LinkBack Thread Tools Display Modes
  #1  
Old 05-06-2006, 09:59 PM
Alan Meyer
Guest
 
Posts: n/a
Default Computerized plant image recognition program



Many of the questions posted to this newsgroup are of the form:
"What is this plant?" with a hyperlink to a photograph.

It seems to me that it ought to be possible to write a pattern
recognition computer program that could match photos to a
database of already identified and cataloged plant photos and
suggest matches.

One approach to this might be as follows:

1. Specify a particular set of photographs to be taken for each
plant in the database. For example:

Mature flattened leaf, photo taken perpendicularly from the
top.

Same, but taken from the bottom.

Shoot, with leaf nodes.

Flower, taken from the top.

Flower, taken from the side.

Bark (for woody plants) taken from straight on.

Seed.

etc.

Ideally, one or more photos of each of the above types would
be taken for a plant. The more complete the imagery, the
more accurate the programmatic correlation could be. But a
program could be made to work with whatever it had, even it
could only produce weaker matches.

Ideally, all photos would be taken with a similar background,
e.g., a white sheet of paper, but any sufficiently distinct
background might work fine for most pattern recognition
tasks.

2. Specify a set of data elements to be stored with the records
for a particular plant.

Information about geographical area, life cycle, stem type,
etc. would be useful.

It would also be useful to have measurements to go along with
each image. In a really advanced program, some of these
might even be auto-generated from EXIF data in digital
photos.

3. Write a program that analyzes characteristics of the images and
stores them, similar to the way that a fingerprint
recognition program isolates and characterizes specific
patterns in an image of a finger print.

Examples of some characters for a leaf photo might be:

Width to height ratio.
Smoothness or roughness of the edge.
Pointedness at the peak.
Presence and type of visible venation
Number of points on each edge.
etc.

Due to variations in lighting and color changes at different
times of the year, the program should emphasize shape rather
than color - just as many field handbooks do for the exact
same reason.

4. When a photo is submitted for identification:

Pass it through the analyzer to identify individual
characteristics.

Match the characteristics against the stored images.

Allow the user to enter any additional information that will
help the program, such as leaf length, geographical area
where the photo was taken, etc.

Display a list of matches to the user, with links to images,
sorted by the closeness of the match.

With time, it might be possible for the program to be refined
to the point where it could assign a confidence level to each
match.

To build the database, a mechanism might be provided on the
Internet for anyone to upload photos and cataloging, and to edit
the data, as with Wikipedia. There might be enough enthusiasts
around to build up a pretty good sized database quite quickly.

As always with such web based collaborative tools the quality
would vary with some people uploading poor and mis-identified
photos. But such mistakes could eventually be corrected.

I am not aware of any program like this already existing, but
perhaps there is one. If not, I'm tempted to try to write one.
I am a professional programmer with much experience in database
management, cataloging and searching but, unfortunately, I have
never done any image recognition and would have to learn a lot to
write this program myself.

So I'm curious:

Does anyone know of such a program now in existence?

Do people think it is a good idea to try to right one?

Is anyone interested in taking on the task (I could probably
be induced to help.)

I make no promises to anyone to do this on my own. I'm not a
young man, and I have a lot on my plate to do already. But, as I
say, I'm curious about whether this approach would find favor in
the botany community.

Thanks.

Alan


Reply With Quote
  #2  
Old 06-10-2012, 05:21 PM
Pipette Filler
Points: 20, Level: 1 Points: 20, Level: 1 Points: 20, Level: 1
Activity: 0% Activity: 0% Activity: 0%
 
Join Date: Jun 2012
Posts: 1
Thanks: 0
Thanked 0 Times in 0 Posts
Thumbs up Re: Computerized plant image recognition program

Alan, you have an important idea here. As an App for smartphones this would be very useful to a wide spectrum of the general public. Integrated with associated databases, a gardener could quickly learn a plant's preferred habit, and other plants that would thrive in the same habit and geographic location. Links would ID expected insects (beneficial/destructive), wildlife attracted to such plants, Edibility, recepies, etc. For campers it would be fantastic as a replacement for a detailed field guide or dichotomous key.

An extension of this idea would be related Apps on the theme of National Geographic Field Guides: Birds, minerals, mushrooms, insects...

I woke this morning wanting an App for my iPhone that you describe here. While I am a biologist, I don't have the programming skills to undertake writing the program. I encourage you to move forward on this important potential.
Hank
Reply With Quote
  #3  
Old 07-29-2012, 10:16 PM
Pipette Filler
Points: 42, Level: 1 Points: 42, Level: 1 Points: 42, Level: 1
Activity: 0% Activity: 0% Activity: 0%
 
Join Date: Jul 2012
Posts: 1
Thanks: 0
Thanked 0 Times in 0 Posts
Default Re: Computerized plant image recognition program

I think this is a great idea. A group in the US has created an app for trees in their area. I am not sure how well it works, but it is similar to your idea.

Google leafsnap for their website.
Reply With Quote
Reply

Tags
computerized , image , plant , program , recognition


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Program in Molecular Plant Biology- Graduate Fellowships ASN Reddy Arabidopsis and Plant Biology 0 11-26-2008 12:23 AM
Graduate Program in Molecular Plant Biology - Research Assistantships ASN Reddy Arabidopsis and Plant Biology 0 10-16-2007 09:11 PM
All customers PAY YOU IN CASH !!! Tia Protein Forum 0 11-19-2005 06:57 PM
All customers PAY YOU IN CASH !!! Tia Protocols and Methods Forum 0 11-19-2005 06:57 PM
All customers PAY YOU IN CASH !!! Tia Microbiology Forum 0 11-19-2005 06:55 PM


All times are GMT. The time now is 07:03 AM.


Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Copyright 2005 - 2012 Molecular Station | All Rights Reserved
Page generated in 0.14770 seconds with 16 queries