+ Reply to Thread
Results 1 to 9 of 9

Thread: Best Navigation Architecture For Domain Database?

  1. #1
    jmcc's Avatar
    jmcc is offline Wannabe Geek jmcc is just really nice jmcc is just really nice jmcc is just really nice jmcc is just really nice
    Join Date
    Feb 2006
    Posts
    462
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default Best Navigation Architecture For Domain Database?

    I've got a database here with the hosting history (new/deleted/transferred/dns added removed etc) for domains going back to 2000. In individual terms, it would be approximately 190 Million pages of content. Any ideas on how to build a navigation architecture (other than a search box)?

    Regards...jmcc

  2. #2
    Briask's Avatar
    Briask is offline Wannabe Geek Briask will become famous soon enough
    Join Date
    Feb 2008
    Location
    Dublin
    Posts
    148
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Its down to what you want to be able to do?

    Theres some nifty data mining architectures, data visualisation tools and navigation methods out there but you really need to start off with some idea of how you want to slice and dice the data.

    What is you want ppl to do with the data? Find specifics?Carry out trend analysis? Visualise the data?

  3. #3
    jmcc's Avatar
    jmcc is offline Wannabe Geek jmcc is just really nice jmcc is just really nice jmcc is just really nice jmcc is just really nice
    Join Date
    Feb 2006
    Posts
    462
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Quote Originally Posted by Briask View Post
    Its down to what you want to be able to do?
    Provide easily accessible domain hosting histories. The simplest way is to provide a search box. But I want to provide alternative searching methods and perhaps a directory structure. The directory structure is the hardest thing.

    Regards...jmcc

  4. #4
    blacknight's Avatar
    blacknight is offline Web Slave blacknight is a splendid one to behold blacknight is a splendid one to behold blacknight is a splendid one to behold blacknight is a splendid one to behold blacknight is a splendid one to behold blacknight is a splendid one to behold blacknight is a splendid one to behold blacknight is a splendid one to behold
    Join Date
    Jan 2006
    Location
    Ireland
    Posts
    7,909
    Thanks
    9
    Thanked 8 Times in 7 Posts

    Default

    Which TLDs are you covering?

    It *might* make some sense to organise:
    • by tld
    • alphabetically
    • number of characters in domain
    • by nameserver
    • by country
    • by age (not sure about that one.. )

  5. #5
    jmcc's Avatar
    jmcc is offline Wannabe Geek jmcc is just really nice jmcc is just really nice jmcc is just really nice jmcc is just really nice
    Join Date
    Feb 2006
    Posts
    462
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Quote Originally Posted by blacknight View Post
    Which TLDs are you covering?
    com/net/org/biz/info/eu/co.uk/mobi/asia for the moment.

    by tld
    This is the one I've implemented already.
    alphabetically
    Each list would be millions of domains long.[/quote]
    number of characters in domain
    That's a good one.
    by nameserver
    Could be tricky - there are loads of nameservers with one domain hosted but there are also nameservers with millions of domains hosted. The history of Godaddy's or Enom's nameservers is amazing.
    by country
    Can be done. But it might not be 100% accurate.
    by age (not sure about that one.. )
    This one is a very interesting option. It would be possible to generate complete lists of domains that were dropped and not reregistered. It would also be possible to identify tasted domains and domain tasters. It could be done on a monthly or yearly basis.

    Regards...jmcc

  6. #6
    Forbairt's Avatar
    Forbairt is offline respect my AW-THOR-IT-AYY Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough
    Join Date
    Jun 2007
    Location
    My Office, Dublin
    Posts
    2,286
    Thanks
    2
    Thanked 5 Times in 5 Posts

    Default

    alphabetically ... could be broken down further into ..

    a -> aa ... ab ... ac .... th -> the...

    listing them alphabetically with just the initial letter wouldn't make too much sense to me ... (unless it was something like dropped irish domains)

    Also .. if you start getting spidered 190 million page hits could be ouch ... not to mention bots potentially collecting all the data from your system (though you've probably thought of that already)

  7. #7
    jmcc's Avatar
    jmcc is offline Wannabe Geek jmcc is just really nice jmcc is just really nice jmcc is just really nice jmcc is just really nice
    Join Date
    Feb 2006
    Posts
    462
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Quote Originally Posted by Forbairt View Post
    alphabetically ... could be broken down further into ..

    a -> aa ... ab ... ac .... th -> the...

    listing them alphabetically with just the initial letter wouldn't make too much sense to me ... (unless it was something like dropped irish domains)
    Yep. This would narrow it down a bit.

    Also .. if you start getting spidered 190 million page hits could be ouch ... not to mention bots potentially collecting all the data from your system (though you've probably thought of that already)
    It gives me nightmares. Google is ok. But the morons in Microsoft and Yahoo with their multitude of braindead spiders would be continually hammering the sites. As for the scrapers, I have no problem with banning entire countries or Class A if they irritate me. The trick is maintaining a healthy balance between giving genuine users the info they want and blocking maggots.

    Regards...jmcc

  8. #8
    Forbairt's Avatar
    Forbairt is offline respect my AW-THOR-IT-AYY Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough Forbairt will become famous soon enough
    Join Date
    Jun 2007
    Location
    My Office, Dublin
    Posts
    2,286
    Thanks
    2
    Thanked 5 Times in 5 Posts

    Default

    Quote Originally Posted by jmcc View Post
    The trick is maintaining a healthy balance between giving genuine users the info they want and blocking maggots.
    Given the nature of this ... would requesting people sign up be that big an issue ?

    Considering a lot of sites are charging for this type of information ... a simple sign up wouldn't be out of the question in my mind

    (remember you posting that you weren't doing it as a commercial venture ... as such on boards)

  9. #9
    jmcc's Avatar
    jmcc is offline Wannabe Geek jmcc is just really nice jmcc is just really nice jmcc is just really nice jmcc is just really nice
    Join Date
    Feb 2006
    Posts
    462
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Default

    Quote Originally Posted by Forbairt View Post
    Given the nature of this ... would requesting people sign up be that big an issue ?
    It would be an extra layer of complexity. What I want to do is to make it as simple as possible to implement and run.

    Considering a lot of sites are charging for this type of information ... a simple sign up wouldn't be out of the question in my mind
    Possibly but only for the more intricate information. Sessions, users, authentication in php scares me.

    (remember you posting that you weren't doing it as a commercial venture ... as such on boards)
    I'm trying to remember writing that.

    Regards...jmcc

+ Reply to Thread

Similar Threads

  1. Connecting to 2 Mysql database in the same script??
    By Ciarán Mc Cann in forum Coding Help
    Replies: 11
    Last Post: 24-07-2007, 10:21 AM
  2. Restoring a database
    By JamesA in forum Forum Management
    Replies: 4
    Last Post: 04-02-2007, 11:40 PM
  3. recomend IP to Alpha2 and dialing code database
    By CiaranR in forum Webmaster Discussion
    Replies: 2
    Last Post: 27-01-2007, 03:40 PM
  4. How many scripts on one database?
    By ButtermilkJack in forum Webmaster Discussion
    Replies: 4
    Last Post: 17-04-2006, 02:13 PM

Visitors found this page by searching for:

Nobody landed on this page from a search engine, yet!
SEO Blog

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Search Engine Optimization by vBSEO

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64