Weaponsmith Archive

Thread: Experimentation crafting bug

Odaen
Sat Mar 27, 2004 4:31 pm
#1

Well I'm sure there will be few surprised by this assertion that there is a bug in the experimentation code. But I have definitively proven to myself that it is not just a myth. I will explain how it can easily be proven and reproduced by developers. I am a new Master Weaponsmith but have been a master Artisan and an architect on wanderhome for over six months. Exactly what the bug is and how it affects us is not easily understood but by showing how developers can reproduce it, they can look at the code and fix it and perhaps that will bring a much more pleasant and predictable experience to all of us that craft and experiment. I first noticed the bug months ago when I started using resources in harvesters and components that had 1000 UT or Shock or some other stat. I would get moderate successes or good instead of great. I still have lots of 1000 UT or shock resources that I never use because of this bug. How I finally prove to myself the bug was easy last night. Two things happened.


First off let me say I am no stranger to experimentation. All experiments use two points using 100% crafting tools and a droid or in one case a 45 functionality crafting station.


I went to a WS friends house on Bria who had a 45 functionality crafting stations (a perfect station). One that was created during the 1 day experimentation change rules the first day of this current patch. I was using a 15.0 functionality crafting tool made with 1000 CD copper. I was experimenting a vibro knuckler using 1000 Shocksteel that had 373 maleability. I tried to experiment four knucklers and got good success or moderate success many times so that I was not able to complete the experimentation to my satisfaction. I thought, what is going on here cause that had never happened before. I went away, started using my droid and the problems went away. So there is a problem using 100% crafting stations with a 1000 stat resource.


Later I tried to make a simple metal staff using 1000 shock metal again with 373 maleability. I tried three times and kept getting moderate success over and over. I was using a 100% crafting tool. I finally said forget it and used a 983 shock steel that had 374 maleability and had no problem getting great success every experimention I did.


Now I realize that doing three or four tests is not scientific but I am not gonna do 1000 or even 100 experiments to show that experimentation just does not work using 1000 stat resources. If I get three or four failed attempts in a row at a 45 functionality station using 100% tools and 1000 stat resources, I'm sorry, but I'm just walking a way. Its a shame that the code can't handle these boundary issues correctly and hope it gets fixed. It may well affect crafting with any resource that is very high or any very high quality crafting stations. Best thing that can be done is just for a developer to reproduce these problems and debug the code.



-------------------------------
Machine Mojo, Bria
Unlocked after 24 professions
Master Weaponsmith/Artisan/Architect shop at -410, -5480 south of Coronet
Machine Dragon
Novice Teras Kasi Artist, Novice Creature Handler, Installation Designer, Foreman, Master Artisan
Architect and Master Artisan Shop at -4800, 3400 south of Theed, Naboo
LLJK_Griz
Sat Mar 27, 2004 8:09 pm
#2






Odaen wrote:


Now I realize that doing three or four tests is not scientific but I am not gonna do 1000 or even 100 experiments to show that experimentation just does not work using 1000 stat resources.





If you can't be arsed to try more than three or four times then you have not earned the right to claim anything is broken, because YOU HAVE NOT PROVEN ANYTHING.


I can craft three or four perfect items in a row. Does that mean experimentation is broken in favor of crafters? Obviously it does not.


Stop posting and go read a statistics textbook.



POKEY THE PENGUIN SIG REMOVED BY GARVA BECAUSE "Just because you are crafty enough to get around the technicality of it being a .jpg or .gif does not mean it is not an image, it is not ascii art, it is an image" SO HERE IS MY NEW SIG.
HUGE UGLY SIG
bandera
Sun Mar 28, 2004 9:09 am
#3

to me it sounds like griz has some problums with himself. seems like Odaen was just bringing up an issue for the devs and he comes in and flames funny person he is very funny.
xendro
Sun Mar 28, 2004 2:28 pm
#4

He isn't being lazy, he doesn't burn up any of his hard-earned high-stat ancient materials to test something the devs should be able to test themselves. Perhaps you have some 1000-stat resources you would be willing to waste to do a "proper" experiment?



Xendro D'Arzaa
Retired
Master Popcornsmith
Apprentice Forum Troll

One who is not confused by the world may be the most confused of all.

Odaen
Sun Mar 28, 2004 2:46 pm
#5

Griz, using a bell curve then even three or four experiments is enough to show that something is potentially broken here and if I did do a scientific experiment about 1000 times then its not like the devs are gonna take that information and use it for anything. Only thing that would happen is that I would lose 10000 units of my 1000 stat metal. The odds of something unusual like a moderate success happening five times in a row using 100% tool, 100% station and 1000 stat metal and then getting great success when not using that configuration over and over again is astromonical. There is enough information presented here to justify a professioncorrespondent to look into the matter himself or herself and forward the information to a developer to look into it further.



-------------------------------
Machine Mojo, Bria
Unlocked after 24 professions
Master Weaponsmith/Artisan/Architect shop at -410, -5480 south of Coronet
Machine Dragon
Novice Teras Kasi Artist, Novice Creature Handler, Installation Designer, Foreman, Master Artisan
Architect and Master Artisan Shop at -4800, 3400 south of Theed, Naboo
LLJK_Griz
Sun Mar 28, 2004 3:44 pm
#6

You cannot use a bell curve to describe systems that are not perfectly random. It is well-known that SWG's "random" number generator tends to produce long streaks of non-random results, thus a set of 3-4 consecutive bad experiments can be expected frequently.


I have some 1000 SR metal, and it works the same as every other metal.




POKEY THE PENGUIN SIG REMOVED BY GARVA BECAUSE "Just because you are crafty enough to get around the technicality of it being a .jpg or .gif does not mean it is not an image, it is not ascii art, it is an image" SO HERE IS MY NEW SIG.
HUGE UGLY SIG
LLJK_Griz
Mon Mar 29, 2004 1:36 am
#7

Did you miss the part where HE DOESN'T HAVE ANY VALID ISSUES BECAUSE HE'S TOO LAZY TO DO PROPER TESTING?





POKEY THE PENGUIN SIG REMOVED BY GARVA BECAUSE "Just because you are crafty enough to get around the technicality of it being a .jpg or .gif does not mean it is not an image, it is not ascii art, it is an image" SO HERE IS MY NEW SIG.
HUGE UGLY SIG
Amay
Mon Mar 29, 2004 4:39 am
#8

Hey Griz S-T-F-U! The other two are right u just like to argue. lol its not our job to test the games system and pay them monthly to do it A-S-S



Amay Strike Professor of Weaponsmithing
WEAPONS VENDOR!
WP= -4939 3187 NABOO, JUST OUTSIDE OF THEED

Solo Nerf???I don't care about no stinkin solo nerf! Go get a job! I bet you have food, drink, a roof over your head, and a nice ride...porbably even a little illegal stash of drugs. Well if you want toys you gotta find some income, because you looters are to dang greedy=P
enok5us
Mon Mar 29, 2004 11:51 am
#9

I do think more testing should be done. I also know that a small number of tests can somewhat accuratly represent a larger number. As far as griz goes I would like to see him back up his following statement.


"It is well-known that SWG's "random" number generator tends to produce long streaks of non-random results, thus a set of 3-4 consecutive bad experiments can be expected frequently."


Not just with anecdotes but with some hard numbers. Any random sample looked at in a short time has the possibility toshow signs of order. I do not dought the fact that things may be buggy. I just ask that before someone calls another names for trying to look at things in a logical manner that they improve their constructive critisism skills.


It is much easier to ask why so few tests were done and have a rational discussion about the propper sample size than call names.






Enok
Kauri - Tatooine
Master Weaponsmith & Artisian
Send in-game email for orders


stryfex03
Mon Mar 29, 2004 12:08 pm
#10






Amay wrote:
Hey Griz S-T-F-U! The other two are right u just like to argue. lol its not our job to test the games system and pay them monthly to do it A-S-S






The other 2 can't say they're right because they don't have enough facts to support their position. Well, actually, they can say they're right, but that doesn't make them right. 3 sample data points isn't enough to make any scientific conclusion.
MadcowwithSARS
Mon Mar 29, 2004 12:32 pm
#11

still either way,its not our job and shouldnt be our job to experiment on game mechanics.we pay those tards $15 a month to do that.i dont look down on anyone that takes time out of their day gaming to do experiments.and they dont need some arshole telling them the flaws of their experiment.least you coulda done was not have been such an idiot in your pointing out of his flaws.try supporting somone willing to find mistakes in game mechanicsinstead of critisizing them.



"No botha de' Jabba"


- Cant Wait till Grumpy People Quit I Like NGE

Carp-L Tunnel (Former MWS/MM/MA now Master gimp)
LLJK_Griz
Mon Mar 29, 2004 4:47 pm
#12

I was rather angry that day, I don't remember why.


As for the RNG sucking, many crafters have experienced strings of crafting attempts where you get the exact same experiment results at the exact same points, e.g. three points into damage = great success, three more = great,three more = great, one more = moderate. I once had this happen over five times in a row. Then I moved around a bit, and that unstuck the RNG and returned the experimentation results to the normal pseudorandom state.


This happens quite a lot, and in a truly random system the odds of this many people experiencing it this often are very close to zero.




POKEY THE PENGUIN SIG REMOVED BY GARVA BECAUSE "Just because you are crafty enough to get around the technicality of it being a .jpg or .gif does not mean it is not an image, it is not ascii art, it is an image" SO HERE IS MY NEW SIG.
HUGE UGLY SIG
Amay
Mon Mar 29, 2004 8:43 pm
#13

HERE IS THE POINT U NUMBER CRUNCHIN BOYS!-U PAY TO PLAY NOT TO LOOK OR EVEN FIND THE DEVELOPERS OR FROGRAMERS OR EVEN THE SERVERS BUGS OR SCREW UPS! WE PAY SO WE SHOULD JUST PLAY AND IF IT SCREWS UP WE GET TO COMPLAIN! SO SHHHHHHHH! NUMBER NERDS!



Amay Strike Professor of Weaponsmithing
WEAPONS VENDOR!
WP= -4939 3187 NABOO, JUST OUTSIDE OF THEED

Solo Nerf???I don't care about no stinkin solo nerf! Go get a job! I bet you have food, drink, a roof over your head, and a nice ride...porbably even a little illegal stash of drugs. Well if you want toys you gotta find some income, because you looters are to dang greedy=P
Page 1 of 2
Previous Next