QUOTE(BobLfoot @ Feb 14 2007, 12:25 AM) [snapback]49720[/snapback]
Let me see if I am reading the problem correctly. The readings from the scale are displayed in values of 0.01 lbs increment. At present when you pass a 0.10 lb weight you get a reading of no more than 0.11 and no less than 0.09 lbs. This is the trade requirementof +/- one division. Your reading of the 0.05 lb weight however does not fall in the 0.04 to 0.06 range and QA is not happy with this. If this is a correct restatment of your problem then read on.
First Question - what is the actual or raw resolution of your system? I could not find a manual for the 1746-ws module to provide this answer thru the ab literature library so I assume it is some third party product. What I mean is this if your load cell is rated 0 to 100 lbs and your output is in 12 bits. Then you have 4095 divisions at 0.02442 lbs per division. Your final accuracy cannot exceed your initial. In this case it would be impossible to gaurantee the results you want. Now 0 to 100 lbs with 16 bits would yield 32767 divisons and 0.00305 lbs per division. THis would give you few problems achieveing your final accuracy.
I am sorry, I miss stated my load cell module. I am using a 1769-ws module by Hardy. I am using a 300 lb capacity load cell with 5 volt excitation. As for my resolution, the load cell module has an internal resolution of 1:8,388,608. My weight reading uses up to a total of 32 bits depending on the decimal point location. I am currently able to display my weight reading in .01 multiples (i.e .01, .02, .03, .04, etc.). I need to display in multiples of .05. (i.e .05, .10, .15, .20, .25, etc). If I can convert my display into .05 divisions then my calibration range is +/- .05 ( with a 10 lb weight could be 9.95 or 10.05) wich is acceptable for calibration. I am just unsure on how to achieve this conversion or if it is even possible.
QUOTE(Alaric @ Feb 14 2007, 02:15 AM) [snapback]49721[/snapback]
Is this the module you are using?
http://www.hardyinstruments.com/process_we...gh+scale+moduleOr is it this module?
http://www.hardyinstruments.com/process_we...logix%AE+moduleI'm wondering because you said it was a 1746-WS, which is for the SLC-500 PLC, but you said you were using a ML1500, which would use 1769 modules, not 1746 modules.
The 1746 module has a resolution of 985000 counts and the 1769 module has a 23 bit A/D for a whopping 8388607 counts, so I don't think this is an issue of resolution.
What range is your load cell and what voltage are you using to excite it? You also mentioned that the application is a high speed batching operation. How fast are you taking measurements? Is it faster than the conversion rates of the module?
I am sorry, I miss stated the load cell module. It is a 1769-ws by Hardy. The load cell has a 300 lb capacity and uses a 5v excitation. I am unsure of your question about how fast am I taking measurements. I am measuring the the weight continuously as it is batched. I have the number of averages set very low to a setting of 5 to provide enough reaction speed. Unfortunately, the low number of averages adds to my stability issues. From what I have seen however, displaying at .01 divisions, my weight is only fluctuating by .03 lbs. If I could achieve a division factor of .05 I do not believe I would have any issues.
QUOTE(OkiePC @ Feb 13 2007, 09:26 PM) [snapback]49713[/snapback]
Multiply the floating point result by 20 and make the destination an integer. Then divide that integer by 20 with a float destination.
Note that the original value times 20 must be less than or equal to 32767 for my oversimplified solution to work!
Doesn't the result end up being back into .01 divisions. Lets say my weight reading is 50.03 lbs.
50.03 x 20 = 100.6. As an integer it is 10006. 10006/20 = 500.3 This is basically where we began. To scale this back down 500.3/10 = 50.03. Am I missing something here. I was hoping that we could convert this into, in this case, 50.05. This would be rounded out to make my .05 divisions.