I found that the MaxMind's GeoIP database's accuracy is 99.5% (free) or 99.8% (commercial), as published in their website. Does anybody know what would be the 0.5% and the 0.2% ?
Are they newly assigned IP addresses, or actual addresses that change their countries?
I feel that my question is not very clear but any answers are welcome.
A bit late, but the MaxMindGeoIP Country page spells this out a bit.
Basically the paid version corrects for AOL, and "some" anonymous proxies / satellite providers.
I get the sense that AOL is the biggest issue. For the free version, all AOL users show up in the US, while the paid version correctly identifies AOL users in Great Britain, France, Germany, and Brazil. I don't know how many people use AOL in Europe these days, so I'm not sure how big of an issue this is.
Regarding what "some" means regarding the anonymous proxies or satellite providers, I have no idea.
Related
I am now developing a social application. But recently I noticed that Firebase is blocked in China. So I want to make sure whether firebase can be used in China?
* EDIT 24 January 2020 *
Some of the information here might be out of date.
Firebase has a China service at https://firebase.google.cn/ which is not blocked in the PRC. (Thanks to #c-an for bringing this up.)
That said, *.google.com and *.googleapis.com are still blocked in China. I'll change/update this as I get more information.
Original Answer
For now Firebase is blocked and can't be used in China, along with other Google services, because the PRC has blocked all URIs with *.google.com and *.googleapis.com.
This also means, for example, that the Play app store can't be accessed from China. If you don't know what's going on between Google and the PRC, here's a primer.
Also, according to Chinese law, user data of Chinese citizens must be stored inside of the PRC. You might be able to get away with only addressing this once you have a significant number of users, but the trend has been for the CCP to crack down more and more on foreign information, even busting VPNs and declaring them illegal despite complaints of academics who say that they need, you know, real information.
As we're now in the run-up to the 19th Party Congress this autumn, we can expect the situation to get worse before it gets better. Maybe 2018 will leave room for relaxation?
For now, very sadly, forget anything Google in China, and be prepared to store user data of PRC citizens on servers located inside the Great Firewall. Also be prepared for seemingly random degradations of your service within China, or to be blocked altogether, along with these other blocked services.
Update 2017-11-23: The 19th Party Congress has come and gone and, if anything, Google services look less likely than ever to become available in China. The great firewall is likely to continue to be strengthened as the Chinese Communist Party extends its role into corporations, and foreign firms are generally disadvantaged.
Update 2018-08-05: Google plans to open a censored version of its search in China, according to leaked documents. It seems reasonable to assume that if a censored Google Search becomes available in the PRC, then Firebase and other Google Cloud products may as well. The censored search plan, code-named Dragonfly, has reportedly been in the works since December 2017, possibly a result of meetings that month between Google CEO Sundar Pichai and an unnamed top Chinese official when they met at the World Internet Conference in Wuzhen, China, where PRC General Secretary and President Xi Jinping gave a speech.
Update 2018-12-23: It appears that Google's Project Dragonfly is now on hold if not outright abandoned. This implies that the outlook for Firebase in China has worsened.
You can build your own Rest API server outside of China, and make the server talks to Firebase rest api endpoints of Realtime db or Authentication, https://firebase.google.com/docs/reference/rest/database. So you web app talks to your rest api server (accessible from China), and your rest api server talks to Firebase.
The answer is NO :
Using a huge part of Firebase services, I contacted the support, this is the answer :
I'm glad you are considering Firebase for your project. However, in
accordance with current U.S. policies, it is not possible to use
Firebase from within certain countries. For more information about
these restrictions, please refer to the U.S. Department of the
Treasury website. The current list is of blocked countries is listed
here. If you have end-users located within China, it's quite difficult
to access Firebase there since the use of Firebase requires Google
Play Services, which most of the devices in China don't have. We
understand that access to our products has been problematic from
within mainland China. We believe it may have been caused by
networking conditions in China, rather than Google's own services.
Since access to services is determined by the respective country's
government and they don't report to Google, the Transparency Report is
the most authoritative it can be.
I just tested and I am able to access my realtime database hosted on the Singapore region in China mainland. No need to modify anything. Whatever works overseas, works in China. Tested in Beijing.
Facing the same problem, if you are in china, install Astrill VPN and change from openweb to StealthVPN, connect to a server like USA for china one and login to firebase. It will work successfully.
Does anyone know of a service (free or paid) or software that I can host for street address completion? I'm interested in providing a list of possible completions for an address string, not geocoding an address.
For example, if a user types "120 An", the service might provide 10 possible completions for that address string (i.e. "120 Anne Way NYC NY, 120 Anteater St. Seattle WA... etc.")
Ideally I would be able to constrain the list of returned addresses to a particular region.
Openstreetmaps had "Name finder" a while ago but it doesn't look like it exists anymore.
I should mention I'm open to hosting the service myself. I believe I can extract the list of region specific addresses from Openstreetmap data, I need an API to put them in though...
There is a Google Places autocomplete API .
SmartyStreets just finished a new autocomplete feature, and it's totally free with an API subscription (which is also free, to a point). I work at SmartyStreets and helped to develop it.
You can put it on your website with the jQuery plugin. It works very well for US addresses. For international, Google might be your best bet, where license restrictions don't get in the way.
I am working on a civics related project and I need to be able to display all the properties in the City of Philadelphia on a map, so I'll need to get the latitude & longitude for all 580,000 properties. (Only once)
Most APIs like Google/Yahoo have limits of 5,000 per day, and even BatchGeo has a similar limit.
Is there a way I can do a one-time geocoding of all these addresses?
You can find a list of free and paid geocoding services at USC site.
Also check Microsoft's Geocode Dataflow API, it allows up to 200,000 entries / 300 Mb and takes up to 14 days.
Another possibility to combine several services at once: use 4 services that allow 5,000 entries a day and you'll finish your task in a month.
You can use Map Quest of Cloud Made.
I have created a small utility to help compare these API's.
The utility is hosted at below url:
http://ankit-zalani.appspot.com/GeoCode/index.jsp
Tobias, I work for an address verification (and recently, geocoding) company called SmartyStreets.
Many services have usage restrictions based on volume and license agreements which prevent users from storing the results of geocoding queries. There are some vendors, however, which don't have limits or restrictions like that.
I would recommend something like LiveAddress which will not only geocode the addresses but also perform CASS-Certified verification to make sure your addresses are correct before giving you potentially faulty coordinates. You can run 580,000 or even millions at a time in a few minutes, and we allow you to store your results.
Hope this helps. If you have any more questions about addresses, I'll personally assist.
This thread is pretty old by now, but there have been some developments in recent years making bulk geocoding very cheap. My favorite option is to just obtain a geocoding server on AWS ( google: geocoding on aws), many options there, some free some with low hourly rates (total cost depends on the server you choose, of course.)
I'm looking for a United States Address Validation web service, as the title says. Also:
I don't need maps
I don't need Geo coding
I do need:
Validation that an address is real
Address parsing
Google's Maps / Bing Maps seemed good, but won't work for me because of these:
Prohibits use if not plotting points on a map image
Low request limits (100,000 / day) for premium account. I need more like 1,000,000 / day
Does Geocoding, which I don't need, which is resource intensive, which means it's slow
Any suggestions?
Maybe USPS?
https://www.usps.com/business/address-management-products.htm
use FedEx's API. They have an API to validate addresses.
Also:
https://webgis.usc.edu/Services/AddressValidation/Default.aspx
You can try Pitney Bowes “IdentifyAddress” Api available at - https://identify.pitneybowes.com/
The service analyses and compares the input addresses against the known address databases around the world to output a standardized detail. It corrects addresses, adds missing postal information and formats it using the format preferred by the applicable postal authority. I also uses additional address databases so it can provide enhanced detail, including address quality, type of address, transliteration (such as from Chinese Kanji to Latin characters) and whether an address is validated to the premise/house number, street, or city level of reference information.
You will find a lot of samples and sdk available on the site and i found it extremely easy to integrate.
You could, in theory, run desktop software and plug into any kind of API it provides, but then you become responsible for things like uptime, data updates, and associated overhead. You may also run into issues with the software threading model--is it multi-threaded or single-threaded software? You don't want to find that out in production.
There are a handful of web services out there that can verify US-based addresses, including the USPS official web service. The USPS one is very limited in the fields that it returns. For example, if you're looking for the "delivery point" which is used to make a full barcode, the USPS API doesn't return that information. I believe the USPS web service also limits the number of queries that you can perform, although I don't remember the exact limit.
A few things that you'll want to look for in a web service include the price (obviously) as well as geo-distribution of their servers. If a company has all of their servers in one location and that data center goes offline (which can and does happen), you're left out in the cold. If they have multiple physical locations, it can help to prevent unnecessary outages. Also, you'll want to make sure that the service call returns all necessary fields as per your requirements--like delivery point code, barcode, and DPV code (which tells you how deliverable an address is).
Lastly, you'll want to determine how you feel about interacting with the company. When you call them on the phone, are they responsive and concerned about your needs? Or are you talking to some front-line person that can't answer questions and is only able to gather information about your company size and revenue so they can evaluate how big of a fish you are and determine which salesman gets to call you back. Can you talk to the engineers that wrote the web service on the phone or via email?
There are a few choices out there and you'll have to choose the one that best fits your requirements and unique situation. Do a Google search to find a list of companies. In the interest of full disclosure, I'm the co-founder of SmartyStreets. We have an address verification web service API called LiveAddress. You're more than welcome to contact me directly with questions on my personal Twitter account or the company Twitter account.
Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 10 years ago.
Improve this question
We need an address finder (premise level) based on postcode. We have a budget of 40k for this. But I have been assigned to find some cheaper alternatives for Royal mail PAF database. Is Google any good to find premise level address when you send full postcode. Any recommendation over Royal Mail PAF file. Any web services out there for this to accomplish? Please share your knowledge.
Cheers,
Naren
We use products from AFD for this, they work well for us.
Edit just saw Best way to geocode UK postcode with Google Maps API? on the front page.
In the UK the government has said that PAF data should be made free[1]. I'm painfully aware of the almost extortionate nature that Royal Mail operate.
Having worked with Royal Mail PAF API, I known a 'friend' (wink wink) that created a class wrapper around the APIs. This 'friend' of mine built a custom Importer that automatically ripped all the PAF data into a MS SQL database. Post the data import, he no longer needs to renew he's licences because he is no longer using PAF data.
This may be something you could do also, buy the data one time an import it.
As for data changes, you can buy perhaps every few years e.g. 2-3 years and do a update of your existing data.
[1] Damn It! guess I was wrong, http://www.guardian.co.uk/technology/2010/jan/22/postcode-petition-fails-blocked-number-ten
I work as the integrations specialist for Postcode Anywhere (we are one of the leading Royal Mail PAF resellers). Address capture doesn’t have to be expensive – and you don’t have to sacrifice reliability for an affordable service. Postcode Anywhere can be licensed either on a simple credit pack based system or on an annual basis, and you can be up and running in 10 minutes using our JavaScript client. If you are looking to create a more bespoke integration we also have an array of web services and code samples to help you.
If you want to have a play around with the service to see what you think we will be more than happy to provide you with a free trial. A full run-down of all of our products and services can be found here: http://www.postcodeanywhere.co.uk/products.
I work for CraftyClicks.
There are a few PAF resellers around. The data is all the same, prices can vary significantly. Best to spend a few minutes browsing the various sites.
At CraftyClicks our focus is on uptime/availability and keeping the price of PAF data reasonable - at high volumes the price falls to well below 1 penny a click.
Our address lookup web service can be integrated client side via JavaScript or server side via XML.
Let us know your requirements (adam at craftyclicks.co.uk) - you shouldn't be spending anywhere near 40k for this!
Adam.
The base PAF data is the same but a lot of value is put into adding information that is not included into PAF to help with realtime and batch addressing matching with products based on PAF. We have a lot of locality information that is not included within PAF but people tend to use within their address.
As to updates, there are thousands of changes every month so its vital that you use a source that has regular updates to the PAF data and also associated files such as business and consumer names data that also help in the matching process.
Have a look at our site www.capscan.com for both UK and International data quality with services delivered either installed or as a web service.
You can also contact us on 0207 428 1255