Could some one help in linking my multivariate testing with goals. I have successfully created A/B Testing and everything working fine apart from the value is always Zero. Is sitecore create value automatically or do we need to set goals for the pages to work? As far as i know we need to set goals for the pages.
I have Followed below sitecore documentation which does not talked anything about how to set values for the tests.
http://sdn.sitecore.net/upload/sitecore6/65/marketing_operations_cookbook_sc65-usletter.pdf
Even if we set the goals for a particular page how sitecore going to recognize whether these goals are accomplished by someone coming to that page directly or from the multivariate testing? I am bit confused.
You're mixing up two concepts here. Sitecore Engagement Value tracking, and goal conversion. From your question I gather; what you're trying to accomplish is to determine which variation of say a banner or a promotion, generates the most clicks?
You can achieve this, but your content editors are going to have to manage how they work with this. In very simple terms, it would be accomplished in this manner:
Set up the M/V test, have each of the variations link to different target pages
On each of the target pages, go to your "Analytics" ribbon, and define "Goals" for the page
Assign a different goal to each target page in this manner
Assign each goal an identical value
With these steps in place, and assuming you have no other tests running, this will produce the result you are looking for.
But the point to all of this is - one needs to fully understand what "Engagement Value" means in the Sitecore CEP, and what it can do for you. It's by long and far more than simply determining the highest conversion rate on any one component.
There are tools out there more tailored to the exact scenario you are looking for.
See my answer here: Clarification on Sitecore A/B Testing Results
And the SBOS Accellerators kit: http://marketplace.sitecore.net/en/Modules/SBOS_Accelerators.aspx
It's A/B Testing or Multivariate Testing ultimate target is to achieve a conversion So Create a Goal with a value lets say 10 otherwise values will be always zero. for any combination of component if the goal is achieved then for that combination value will be 10 it's called conversion. if conversion not happened for any combination values will never increase. after a long duration of test results will show the best possible combination.
Note : Total value never cross the max value of that goal i e 10.
Example for a particular combination say 5 times goal reached is Max 10.
for 1 conversion /5 visits, value is 2. 2 conversion /5 visits value is 4.
Related
For example, scanning the wine to tell you its name by Vivino.
But, seriously, scanning its barcode is faster and easier with high accuracy. Why do they design to use AI to scan the product by computer vision (object identification)? Is it necessary, mate?
This is not a question that is appropriate for this site.
Your question is likely to be a statement of opinion.
The answer is, not which is better, but the issue of segregation.
The product scanner does not replace the barcode scanner. At least soon.
For example, there are products that do not have source marking and are difficult to apply in-store marking.
In order to save labor, reduce time, standardize, and mechanize these products, product scanners that use AI will be good parts.
In addition, even for products that already have barcodes, it is possible to acquire the information of the target actual product and display it additionally.
At first, every product has a part that seems useless and exaggerated.
However, according to market evaluations, some of them will disappear and some will be sophisticated and essential.
That's always happening and your question seems to be one of them.
I've been conducting black box testing for a software program that does engineering analysis on different types of concentrated solar power (CSP) models.
The quality assurance testing I've been conducting has involved only changing one default parameters of the model at a time. It's been very simple where I've just been verifying whether or not the output matches the expected result.
However, now I want to start exploring combinations of configurations that differ from the default set up to investigate if any of these combinations will output an incorrect value or even cause the user interface (UI) to fail.
The first instance I am working with, the UI has (6) different types of parameters I am expected to explore with respect to the default configuration. On top of this, I want to explore combinations of the (6) configuration options by varying them by either increasing (+) or decreasing (-) them, with respect to the default configuration.
As you can imagine, by wanting to explore these (6) parameters in combinations of (+) & (-), I'll easily create many MANY different types of black box tests.
Is there any suggestions on how to conduct these black box tests in a more efficient way? I am trying to avoid conducting all different types of configurations while still exploring the computing code in all aspects.
We have recently started using Sitecore A/B Testing and I am getting lots of questions about how the scoring works. I have been through the relevant Sitecore DMS documents but I still am not 100% sure if I understand how the scoring works.
My basic understanding is that the scores are based on Value Per Visit and my assumption is that the the value relates to the whole visit and not just the specific components we may be trying to optimize with the A/B Test.
For example, if option A has a goal associated with it worth 5 points, anyone presented with this option would get 5 points PLUS any other goal values they trigger during that visit to the site. That might add 5, 10, 50 or more to the visit score and then the option A score would be "total visits score/total visits".
Can anyone confirm if my assumptions are correct or explain where I may be off base? Can a user presented with option B change the score for option A?
By default, the Engagement Value is calculated on a per-visit basis. So your assumption is basically correct - and it does make it hard to test how a particular component variation does against another.
That being said; there are tools to help you.
We're currently implementing SBOS Accellerators into our solution. We have the same issue you are describing, and need a more fine-grained approach to testing.
Basically SBOS accellerators will allow you to track individual personalisation performance, not "just" looking at the overall Engagement Value.
Lars Petersen blogs about it here: http://www.larsdk.dk/2014/01/must-have-marketplace-modules-for-sitecore-digital-marketing-system/
Marketplace link for the module here: http://marketplace.sitecore.net/en/Modules/SBOS_Accelerators.aspx
We found a few issues in testing the module, but none were really severe. I know these issues are being fixed if they haven't already.
I am working with Google Maps on Android 4.0 and I would like to know:
Is there a testing framework (or anything..) that can interact with the Google Maps API? What are the possibilities when interacting/testing with Google Maps on Android? Is it not possible to find all pins on the map and perform a click on them or perhaps determine zoom level?
There seem to be a couple questions on this website dealing with similar issues/questions with no answer.
I realize "interact with" is a broad term. I am really looking for any kind of help whether it is a suggestion or just to tell me something is not possible.
I have been using JUnit but it seems limited by itself. Just today I started looking at Robotium since the majority of tests I need to do are UI based. I am new to Robotium so maybe it is possible with this and I have not discovered it yet?
When our team created an Android application that used Google maps, I was able to create tests using the R.id for the map fragment. It is important to note that I had access to the Application's code, so I knew what variables to look for.
Prior to creating this test, I wanted to make sure that I was targeting the correct R.id, so I went into the R file, copied the value and placed it in
assertEquals(id.satellite,copiedRValue);
which returned true, and then build the test around the changeable variable
initialID = solo.waitForFragmentById(id.satellite); //where id.satellite is defined in the R file, eventually would time out and throw error if fragment was not present
//save the map type, leave
//and do other awsome stuff
//before coming back to the map
finalID = solo.waitForFragmentById(id.satellite);//capture the map fragment that is now displayed, again would time out if this specific fragment was not visible
//assert that the fragments are equal
assertTrue(initialID.equals(finalID);
The biggest problem that I had with this test and with other Robotium tests is that I had click events happening to bring in menus and sometimes Robotium would not perform the click, and the test would fail on the click.
This was my first go at testing with Robotium, so there might be other ways to manipulate the R.id values to create a tighter test.
In case anyone wants to know after much searching I finally found something that can test Google Maps. Things such as zoom level and I believe tap pin (method is called tapMapMarkerItem()) are supported. I have not tested the pin tap yet tho.
Apparently the awesome Robotium does not support map testing by itself. Nicholas Albion was nice enough to create an extension to provides testing support for maps on Android. Thank you so much Nicholas!
So here it is:
1. Download the Robotium jars from robotium.org (I found this helpful http://www.vogella.com/articles/AndroidTesting/article.html - by Lars Vogel)
2. Download the extension from https://github.com/nalbion/robotium-maps
I'm currently building a web app for a UK company with many outlets in the UK. I want to implement a 'find my nearest' based on the following.
Postcode
Landmarks
So the user could enter either to get a list of their nearest. I've done this before using postcode data in a database and then using Pythagoras to figure out the nearest ones.
Ideally I would like to use a web service to do this but I cant seem to find any at all.
My question would be - What would be the best way to implement such a service ? 3rd party app or do it myself. ?
There are various options listed very sanely and even with UK specific notes here
You should externalize the reverse geocoding (from postcode to coordinates) and then intersect the stores location with the coordinates of the postcode or location to get the nearest one. There is another example here.
The reason to externalize the geocoding is to relieve you from the need to update such a database continuously which might not even be feasible given your constraints.
Take a look at the Geokit gem, for ideas if not for implementation.
Also, in the UK you can get quite markedly incorrect answers if you use Pythagoras. You really want Haversine, and someone else has almost certainly done the hard work no matter what platform you're on.