RootsChat.Com

General => Technical Help => Family History Programs, Tree Organisation, Presentation => Topic started by: mrigger on Monday 24 September 12 18:50 BST (UK)

Title: GEDCOM to XLS conversion
Post by: mrigger on Monday 24 September 12 18:50 BST (UK)
Hi!

Some time ago I started to write an Excel based application to convert GEDCOM files into a tabbed XLS spreadsheet. For various reasons I had to shelve the project but now I am in a position to start work again.

The finished application will be released as freeware to anyone who can make use of it. In the meantime I need some help! At this stage, I am looking for forum members who can provide me with GEDCOM files exported from differing genealogy programs. I only use PAF, so output from differing programs will help me ensure that the input process is as stable and robust as possible.

I am not looking to 'steal' anyone's research, and I certainly don't want any information that relates to living individuals. Any and all information will be handled securely and confidentially, and will be deleted after I have finished the testing stage. So is anyone willing to help? I will also need a few volunteers later to beta test the application, but at the moment it is the data that is important.

I do hope that some of you will consider helping out .

Best wishes

Mark
Title: Re: GEDCOM to XLS conversion
Post by: danuslave on Monday 24 September 12 23:54 BST (UK)
Hi Mark

I use Legacy and would be happy to provide a GEDCOM

How much data do you want and how do we deliver it?

Linda
Title: Re: GEDCOM to XLS conversion
Post by: Alexander. on Tuesday 25 September 12 00:01 BST (UK)
Hi Mark,

I wouldn't have thought it matters which program is used, because the GEDCOM output should be the same regardless of the program. Anyway, if you would like to test a GEDCOM generated by RootsMagic, I can provide one.

I must say, I am intrigued as to why you would want an entire GEDCOM in XLS format.

Alexander
Title: Re: GEDCOM to XLS conversion
Post by: danuslave on Tuesday 25 September 12 00:25 BST (UK)
Quote

the GEDCOM output should be the same regardless of the program


I believe there are slight variations between programs, although most programs can ignore anything that they don't need without falling in a heap   :o ::)

Linda
Title: Re: GEDCOM to XLS conversion
Post by: mrigger on Tuesday 25 September 12 09:45 BST (UK)
Thank you all for your responses - it is much appreciated!

Quote
I must say, I am intrigued as to why you would want an entire GEDCOM in XLS format

....mainly because at one stage I was exchanging information with relatives who didn't use genealogy software (but did have a spreadsheet application or viewer), plus I wanted to improve my programming skills  :P

Quote
How much data do you want and how do we deliver it?

Your choice, although the more individuals there are in the GEDCOM file, the better (from a testing viewpoint). Please feel free to make available as much (or little) data as you feel comfortable with. Please PM me and I will give you an email address where you can send the data.

Once I have the data, I will process it and send the results back to you in an Excel tabbed spreadsheet (if you don't use Excel, don't worry - the data should be visible in most Spreadsheet applications, or you can use the free MS Excel viewer application). This initial data will consist of a breakdown of all the data in the file. After some bug fixing, I intend to modify the application to allow you to compare two GEDCOM files, but more of this later.

Thanks again for your responses, and I hope you can assist.

Best wishes

Mark

Title: Re: GEDCOM to XLS conversion
Post by: Ruskie on Tuesday 25 September 12 11:52 BST (UK)
I have Family Historian. If I can work out how to send you a Gedcom I will do so.  :)
Title: Re: GEDCOM to XLS conversion
Post by: jc26red on Wednesday 26 September 12 03:51 BST (UK)
You might want to see the export options, this is from RootsMagic as it will make a difference to your excel layout.
the drop down box options:
Names: Full name or living
Facts: there are 6 options, variations of Date/year/place and don't print facts

Also, why don't you download the free downloads of the FH programs which are available to test? That way you will get a better picture of how each FH program exports its data.  Once you get that right, testing larger gedcoms shouldn't cause a problem.  Testing gedcoms people send to you blind without knowing the options chosen is really hit and miss on getting your application to work properly without bugs.
Title: Re: GEDCOM to XLS conversion
Post by: mrigger on Wednesday 26 September 12 08:33 BST (UK)
Quote
You might want to see the export options, this is from RootsMagic as it will make a difference to your excel layout.

A valid point, but as I cannot guarantee what application the GEDCOM was created in, nor what fields it contains I have had to make the import code fairly forgiving in terms of missing /additional fields.

Quote
Also, why don't you download the free downloads of the FH programs which are available to test? That way you will get a better picture of how each FH program exports its data.  Once you get that right, testing larger gedcoms shouldn't cause a problem.  Testing gedcoms people send to you blind without knowing the options chosen is really hit and miss on getting your application to work properly without bugs.

Again, a valid point, but the problem here is that it would only ever be me creating the test data - it's far better from a testing standpoint to use real data - no two people will enter data in the same way, so this is a much better way of testing in my opinion.

Thank you for your comments - they are appreciated!

Best wishes

Mark
Title: Re: GEDCOM to XLS conversion
Post by: KGarrad on Wednesday 26 September 12 08:58 BST (UK)
Thank you all for your responses - it is much appreciated!

Quote
I must say, I am intrigued as to why you would want an entire GEDCOM in XLS format

....mainly because at one stage I was exchanging information with relatives who didn't use genealogy software (but did have a spreadsheet application or viewer), plus I wanted to improve my programming skills  :P


Thinking laterally . . . RootsMagic comes with RootsMagic-to-go, which allows you to generate a free-standing CD of your family tree.

Probably other genealogy programs also do something similar?
Title: Re: GEDCOM to XLS conversion
Post by: mrigger on Wednesday 26 September 12 09:11 BST (UK)
Good morning

Quote
Thinking laterally . . . RootsMagic comes with RootsMagic-to-go, which allows you to generate a free-standing CD of your family tree.

Probably other genealogy programs also do something similar?

Very true, and another valid point. I'm not trying to replace any of the functionality of other FH software, just give anyone who needs it a free alternative. Also, the plan for the application is also to allow you to compare two GEDCOM files for duplicates, etc., as well as allowing search & filter functions.

Regards

Mark
Title: Re: GEDCOM to XLS conversion
Post by: danuslave on Wednesday 26 September 12 10:06 BST (UK)
Quote

plus I wanted to improve my programming skills


Don't forget this bit guys!  As a retired analyst/programmer, I know how Mark feels.  Getting the thing to work is at least as important as what it does.   :)

Linda
Title: Re: GEDCOM to XLS conversion
Post by: [Ray] on Wednesday 26 September 12 15:05 BST (UK)
Hi Mark

I think that you have a great idea.

There is only one current standard definition for GEDCOM fiiles
Version 5.5 is where it last stopped.
[ http://homepages.rootsweb.ancestry.com/~pmcbride/gedcom/55gctoc.htm ]
Version 6 doesn't look like it will be around anytime soon, and looks like it may be totally different (closer to XML style)

Some [most?] genealogy programs cater for a strict v5.5 then one of their own.

I would have thought that you start by getting the standard v5.5 working first
[ coz then you have a benchmark to work to ]

Ray

[ Another Retd AnalProg, although also keeping hand in ]
Title: Re: GEDCOM to XLS conversion
Post by: Berlin-Bob on Wednesday 26 September 12 15:53 BST (UK)
Quote

plus I wanted to improve my programming skills


Don't forget this bit guys!  As a retired analyst/programmer, I know how Mark feels.  Getting the thing to work is at least as important as what it does.   :)

Linda

As a still-working analyst/programmer I can endorse that wholeheartedly. I am currently working on a new database project for RootsChat and, as with all my other RootsChat projects, on the one hand it is good to make something that others will find useful, and on the other hand, there is a big thrill in trying out different possibilities and watching them enfold, as the work progresses.

Mark, keep at it: it's a good idea, it keeps the grey cells active, and ... it gives you pleasure - ideal !! :)

As Ray suggests, concentrate on the the official 5.5 Standard first, before you start adding genealogy-program specific GEDCOM tags. That is just a bonus.

regards,
Bob
Title: Re: GEDCOM to XLS conversion
Post by: seahall on Friday 28 September 12 09:32 BST (UK)
Hi All.

Not sure if I would get the same information that Mark needs in a .xls file.

I use GEDxlate which makes the gedcom into a xls file which I can then
see at a glance where folk were christened, married, buried etc which 
I can not on FTM.

It is a aid to help work out where I need to look next.  :)

Sandy
Title: Re: GEDCOM to XLS conversion
Post by: [Ray] on Friday 28 September 12 11:01 BST (UK)
Hi Sandy

2 things . . . . . .

"Not sure if I would get the same information that Mark needs in a .xls file"
What exactly does that mean?

GedxLate was last updated Apr/2009 according to the website.
The owner acknowledged outstanding fault(s).
If Mark only provides a more recent, uptodate, version, isn't that also a step forward?


Regards

Ray
Title: Re: GEDCOM to XLS conversion
Post by: seahall on Friday 28 September 12 20:57 BST (UK)
Hi Ray.

In answer to your question.

Quote
Once I have the data, I will process it and send the results back to you in an Excel tabbed spreadsheet (if you don't use Excel, don't worry - the data should be visible in most Spreadsheet applications, or you can use the free MS Excel viewer application). This initial data will consist of a breakdown of all the data in the file. After some bug fixing, I intend to modify the application to allow you to compare two GEDCOM files, but more of this later.

Mark maybe looking at more than I view in my excel sheet as he will breakdown
all the data not just what is accessible to me by Gedxlate.

As to when Gedxlate was updated is not a problem for me as I previously
said I just use the data to see where the families move to between
being hatched, matched and dispatched.

Not sure what your last comment means as I was not making any comparison
with what Mark is trying to achieve.

All the best Mark in achieving your goal.

Sandy
Title: Re: GEDCOM to XLS conversion
Post by: jc26red on Friday 28 September 12 23:38 BST (UK)
I've not tried GEDxlate. I usually rely on the lists and custom reports with RM which work well for me.

Thanks Sandy...   ;D

that was a quick test, it wouldn't install on Windows 7, missing file giving a runtime error.  Will try on an older pc tomorrow :-\

Good luck with your project Mark..
Title: Re: GEDCOM to XLS conversion
Post by: [Ray] on Thursday 04 October 12 22:00 BST (UK)
Mark

"Spreadsheet" to Gedcom ?
I can see a number of "uses"

Ray

Title: Re: GEDCOM to XLS conversion
Post by: stbower on Monday 10 December 12 02:09 GMT (UK)
Mark,
I'll be glad to provide test data from Family Tree Maker to GEDCOM 5.5. The export options include selecting a "destination" of FTM versions 16 and 2008-2012, and "Other" - the FTM help says the destination option "creates a GEDCOM-based file that can be better imported into various versions of Family Tree Maker. For example, FTM 16 accommodates the combined Description and Place fields and certain facts that don't allow sources. 'Other' outputs a more generally formatted GEDCOM file."

So I could send different versions.

If you're following through on this project, please let me know, (*). I just tried GEDxlate and SmartGenealogy, both which export GEDCOM to Excel, but neither would run under Win 7/64-bit. Oxy-gen GEDCOM Converter works in Win 7/64-bit, but is too limited (e.g., doesn't output the individual's unique ID).

I also tried ordering GedTool (German), which may already do what you're developing, but costs 20 euros - http://www.gedtool.de/

I was considering writing my own import routine, but still hoping to find one out there. Please let me know if you have a shareware version.

Steve

(*) Moderator Comment: e-mail removed in accordance with RootsChat policy,
to avoid spamming and other abuses.
Please use the Personal Message (PM) system for exchanging personal data.

New members must make at least three postings before being allowed to use the PM facility.
See Help-Page:  http://www.rootschat.com/help/pms.php
Title: Re: GEDCOM to XLS conversion
Post by: [Ray] on Wednesday 03 July 13 22:31 BST (UK)
Hi Mark

What's the latest on this project of yours?

Regards
Ray
Title: Re: GEDCOM to XLS conversion
Post by: webmayo on Wednesday 16 April 14 14:18 BST (UK)
Did this project go through to completion?
I would be interested to know what the results were of testing the gedcoms supplied by members.

I am the author of GenScriber. I have recently included a gedcom import/export. Like Mark, I am in a position of not having gedcom files from various applications to test. It would be good to know which tags are most used.

I ended up just adding the tags I had in my own gedcoms.

L
Title: Re: GEDCOM to XLS conversion
Post by: DrKahea on Saturday 10 December 22 02:08 GMT (UK)
Aloha Mark, our nonprofit needs to convert a Gedcom file of +38,660 individuals to an Excel spreadsheet in order to create a searchable database.  Once you "perfect" the convertion you're working on please contact us. We would like to know if you can assist us and the cost.
Mahalo  www.portuguesecollections.org