elective-stereophonic
elective-stereophonic
Multigateway status reports
Please login or register.

Login with username, password and session length
Advanced search  

News:

Latest Stable Nxt Client: Nxt 1.12.2

Pages: 1 2 [3] 4 5 ... 11  All

Author Topic: Multigateway status reports  (Read 42375 times)

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #40 on: April 01, 2014, 12:29:38 am »

Got the tx confirmed by the network
now waiting on test results for multiple inputs being confirmed on network
However, I have found some nasty error cases that are possible due to not having comment field yet. Binding of NXT transfers with the other coin actions is thus not 100% guaranteed. Good thing we will get comment field soon!

Also, accounting shouldnt be so difficult, but getting all three servers to agree exactly on the exact balance of all accounts is actually not so easy, since one server usually does the actual transfer while the other two wait for confirmation via AM. Then there is the restoring state perfectly from a cold start.

Not the most fun type of stuff for me, but gotta make sure everything reconciles. Now that I finally have the multisig xfers actually working again, I feel the mood for getting this all sorted today. The best way is to simplify the code's control flow to limit the possibilities and then make sure all those cases are correct.

I expect a long night ahead...

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #41 on: April 01, 2014, 03:50:12 am »

I got a multi-input multisig tx to get confirmed, so that is really good news
now if I can get multiacct multiinput multisig to work, then account balance management wont be so bad
As it is I think I figured out how to get the accounts to converge to the average balance

The basic idea is to find the acct with the largest and smallest amount of unspent balance. Then satisfy the withdraw request from the largest unspent output(s) so that there is likely to be a lot of change. Then allocate the change so both the previous smallest and biggest would end up with the same new balance. Cant guarantee this will happen, as there is no assurance that there will be enough change to be able to balance the two accounts, but over time, as the acct balances converge to each other, the odds get better and better that the extreme accts can be matched up. Once that happens, before long all the acct balances should hover around the overall average, though I havent simulated this, it seems like a decent algo

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #42 on: April 01, 2014, 05:49:06 am »

Now I know why most all centralized exchanges use a sweep acct. That makes it easy to know whether an unspent txout is a user deposit or internal transfer.
I cant figure out how to determine with 100% accuracy at the moment this info is needed, eg. suppress spurious asset transfers!, without doing a horrible, horrible thing.

Based on all the uproar XCP's usage of OP_RETURN has generated, the only safe place I can think of to put the linkage is in an actual spendable output. Anything else is likely to be purged by the bitcoin devs who seem intent on controlling what goes into their blockchain. This means a small amount needs to be used for this. Assuming that people are ok with this, I can use this to get the multigateway to be self-sustaining. I am currently setting it to be .0001 of whatever coin, so it is really a small amount when it comes to anything but BTC.

If anybody has a problem with this fee, let me know

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

bitcoinpaul

  • Hero Member
  • *****
  • Karma: +590/-590
  • Offline Offline
  • Posts: 3097
  • Karmageddon
    • View Profile
Re: Multigateway status reports
« Reply #43 on: April 01, 2014, 06:49:53 am »

Set the fee and we talk in the future, if it needs to be changed.
Logged
Like my Avatar? Reply now! NXT-M5JR-2L5Z-CFBP-8X7P3

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #44 on: April 01, 2014, 09:33:06 am »

Saw the finish line and

left to do:
a) generating withdraw request from asset xfer, the hard part is to make sure to do it once and only once.
b) broadcasting a moneysent AM and using that to prevent sending money more than once
c) sanity testing with each of the supported coins
d) manually generate testing deposit addresses and <beta release>

e) google authenticator
f) some sort of automated account balancer to prevent any super large acct
g) instrumentation to allow for easy external tracking of balances
h) fix bugs

i) code review
j) release candidate

Basically I am "code complete" for hardcoded topology setups. Before production, I want to make it runtime configurable, but you can see from the list above, the remaining features (other than google authenticator) are debugging related. It ended up being a lot more new code than I expected, so probably a full day of debugging before beta release candidate.

I will make an initial beta release for advanced users and then write some automated tests to really pound on things before making a larger scale beta release.

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #45 on: April 01, 2014, 10:43:27 pm »

comment field arrived!
Will work on integrating that in today. Well worth it as it makes correlations of NXT asset transfers 100% linkable to specific bitcoind txid. Plus a few other things :)

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

IveBeenBit

  • Full Member
  • ***
  • Karma: +7/-2
  • Offline Offline
  • Posts: 131
    • View Profile
Re: Multigateway status reports
« Reply #46 on: April 02, 2014, 10:26:57 pm »

subscribed
Logged
I need your suggestions for Nxt Podcast ideas. Click here and speak your mind!

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #47 on: April 02, 2014, 11:26:32 pm »

It seems that testnet is finally caught up regenerating, so I am able to resume debugging.
I did manage to get a really good idea during the down time.
Forming a team to make it real.
More news on that soon.

James

Edit: I've generated test addresses for everyone. I will test multiple address scenarios, but have to write instrumentation code so I can see what the multigateway is thinking. Much complexity.
« Last Edit: April 02, 2014, 11:31:12 pm by jl777 »
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #48 on: April 03, 2014, 01:38:57 am »

Just as I say that, 9.0e is out supporting nxtoshis!
gotta rework some code, but this is very good news

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #49 on: April 03, 2014, 08:32:48 am »

testnet still wonky...
did a total housecleaning on the code. Had to restructure it to remove as much knowledge of multigateway from the NXTprotocol code. This is so I can cleanly add more and more functionality without needing for each module to worry about all the others.

Anyway, it was a pretty major change. Just got it to compile and after one silly bug, it actually seems to be running. Hmmm. Expected more bugs.

As soon as testnet is stable, I can finally issue and test new acct numbers, but i still havent been able to get a test for multiple acct multiple input multisig.

Oh, the accounting reconciliation stuff. Always something left to do...

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #50 on: April 04, 2014, 12:06:58 am »

third day in a row testnet reset
no testNXT, so cant test the code
I feel the mood for coding the secret project today

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

Fatih87SK

  • Hero Member
  • *****
  • Karma: +127/-36
  • Offline Offline
  • Posts: 2206
    • View Profile
Re: Multigateway status reports
« Reply #51 on: April 04, 2014, 05:35:07 am »

What is your testnet account?

Found it.
« Last Edit: April 04, 2014, 05:59:05 am by Fatih87SK »
Logged

abctc

  • Hero Member
  • *****
  • Karma: +148/-13
  • Offline Offline
  • Posts: 1396
    • View Profile
Re: Multigateway status reports
« Reply #52 on: April 04, 2014, 06:21:53 am »

..   no testNXT, so cant test the code
- I've sent you 50k testNXT yesterday, 3.4.2014, at 09:04:02 GMT:

Quote
getTransaction:
transaction:  1537229809575493639
hash:   
{
    "referencedTransaction": "0",
    "confirmations": 627,
    "hash": "a67f9293395beb13077fbbe996951a82a6b85a8b78d14ad0caa51458cef669d2",
    "amountNQT": "5009900000000",
    "block": "15504955479361445353",
    "type": 0,
    "amountNXT": "50099",
    "feeNQT": "100000000",
    "recipient": "18232225178877143084",
    "sender": "14386024746077933238",
    "timestamp": 11220037,
    "subtype": 0,
    "feeNXT": "1",
    "senderPublicKey": "dc7b03d7dd03fe316bb3321c65683c7e528dbed6bdedd67d5aeae2e3dd170126",
    "deadline": 120,
    "blockTimestamp": 11221442,
    "signature": "e0700c66902306712d79464312543e181d6ea8f93fe12d5c6117fa618ca9350c60ce0ddf49e99007391a9ac458d41d1a527bb0ec40954d1507d2f0385c3136d8"
}

Please, let me know, if you need more testNXT.
But I have not so much of them, roughly 1M testNXT.
Logged
Welcome to the Nxt generation of crypto!   Magis quam Moneta (More than a Coin)
"Do not worry, it is an attack" (c) Jean-Luc

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #53 on: April 04, 2014, 07:19:40 am »

..   no testNXT, so cant test the code
- I've sent you 50k testNXT yesterday, 3.4.2014, at 09:04:02 GMT:

Quote
getTransaction:
transaction:  1537229809575493639
hash:   
{
    "referencedTransaction": "0",
    "confirmations": 627,
    "hash": "a67f9293395beb13077fbbe996951a82a6b85a8b78d14ad0caa51458cef669d2",
    "amountNQT": "5009900000000",
    "block": "15504955479361445353",
    "type": 0,
    "amountNXT": "50099",
    "feeNQT": "100000000",
    "recipient": "18232225178877143084",
    "sender": "14386024746077933238",
    "timestamp": 11220037,
    "subtype": 0,
    "feeNXT": "1",
    "senderPublicKey": "dc7b03d7dd03fe316bb3321c65683c7e528dbed6bdedd67d5aeae2e3dd170126",
    "deadline": 120,
    "blockTimestamp": 11221442,
    "signature": "e0700c66902306712d79464312543e181d6ea8f93fe12d5c6117fa618ca9350c60ce0ddf49e99007391a9ac458d41d1a527bb0ec40954d1507d2f0385c3136d8"
}

Please, let me know, if you need more testNXT.
But I have not so much of them, roughly 1M testNXT.
yes thanks! I now have testNXT, at least until next testnet rewind :)
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #54 on: April 05, 2014, 01:05:05 am »

Finally! No new testnet. I have testNXT. all the accounts funded and have assets.
Generated test addresses for everyone. just had to change "fee" to "feeNXT", I should change it to NQT

Then finally, finally, test multiacct multinput multisig withdraws
With a few days off from multigateway, I should actually have better eyes to see what silly things i did after allnighters
Yes, yes, have to put in the instrumentation. Not sure why I am finding it hard to get myself to do that...

James

P.S. secret project needs multigateway, so everything is connected
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

Fatih87SK

  • Hero Member
  • *****
  • Karma: +127/-36
  • Offline Offline
  • Posts: 2206
    • View Profile
Re: Multigateway status reports
« Reply #55 on: April 05, 2014, 07:20:21 am »

Exciting!
« Last Edit: April 05, 2014, 07:25:26 am by Fatih87SK »
Logged

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #56 on: April 05, 2014, 08:07:30 am »

so many little bugs. yikes, forgot that i was cut off right in the middle of a rewrite. almost have it finally doing automated verified withdraws, but only so much of this type of debugging I can do in a day, especially when super cool secret project is calling my name!

I will split my time between them

James
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

bitcoinpaul

  • Hero Member
  • *****
  • Karma: +590/-590
  • Offline Offline
  • Posts: 3097
  • Karmageddon
    • View Profile
Re: Multigateway status reports
« Reply #57 on: April 05, 2014, 08:28:45 am »

Don't get distracted. This 'product' is very important and huge!
Logged
Like my Avatar? Reply now! NXT-M5JR-2L5Z-CFBP-8X7P3

jl777

  • Hero Member
  • *****
  • Karma: +718/-123
  • Offline Offline
  • Posts: 6170
    • View Profile
Re: Multigateway status reports
« Reply #58 on: April 05, 2014, 08:40:08 am »

Don't get distracted. This 'product' is very important and huge!
It doesnt do me or anyone else any good, if I am not making good progress
there is a time for debugging
there is a time for coding
there is a time for designing
there is a time for brainstorming
there is no time for sleep

James

P.S. The secret project enhances multigateway, dont worry
Logged
There are over 1000 people in SuperNET slack! http://slackinvite.supernet.org/ automatically sends you an invite

I am just a simple C programmer

kodtycoon

  • Hero Member
  • *****
  • Karma: +43/-18
  • Offline Offline
  • Posts: 916
    • View Profile
Re: Multigateway status reports
« Reply #59 on: April 05, 2014, 07:47:20 pm »

Don't get distracted. This 'product' is very important and huge!
It doesnt do me or anyone else any good, if I am not making good progress
there is a time for debugging
there is a time for coding
there is a time for designing
there is a time for brainstorming
there is no time for sleep


im am DYING
James

P.S. The secret project enhances multigateway, dont worry

I AM DYING TO KNOW WHAT IT IS!!!! :(
Logged
Pages: 1 2 [3] 4 5 ... 11  All
 

elective-stereophonic
elective-stereophonic
assembly
assembly