Show newer

@freemo @Science

Hey Freemo, I'm alive again xD The bisection search method is pretty clever to reduce your current computation time, but wouldn't that need to be repeated regularly?

Have you considered using some dimensionality reduction techniques to help limit your feature space to the most impactful variables to reduce your search space? It would be a rather long up-front computation more than likely to do the initial clustering, but then you could likely ignore/discard some of the variables that have a smaller impact on your prediction (or have relatively high correlation to other variables/combinations of variables) to make it faster in the future.

@johnabs

Eventually the search routine will get more advanced. For now I need to understand the properties of the search space a bit better before i consider how or where it can or should be improved. For the moment there are only 7 variables and I suspect most of them are fairly insignificant and wont need any optimization of any kind.

Its also a matter of implementation time priorities, the haalving of the search space one variable at a time was the simplest to design in a relative short period of time which is important as I have bigger things to work on right now in terms of debugging a few minor remaining issues (there appears to be some sort of locking missing somewhere that I cant grok that is a top priority and is preventing me from getting reliable error values anyway).

@Science

@awethon Because accounts setup with the purpose of spamming/advertising get deleted.

Threw together a parameter optimization algorithm for my stock trading algorithm last night. Nothing too ground breaking but hell-a useful and cool all the same.

There are about a dozen variables, some of which have some limited dependence on each other. I suspect the search space however is relatively simple based on my expiernce os optimizing it by hand with trial and error.

The challenge is the possible valid range of these variables is huge, most bounded at 0 but with a max that is in the hundreds of thousands.

The other challenge is that each test takes a few minutes to perform (simulated over a years worth of data one minute per data point). So even with some extreme multi-core usage and optimization it is too slow for a naive search algorithm to just do a random walk across the problem space.

So the search pattern had to be an exponential one that pulls back on overshoot in a decaying exponential form as well. Identifies the boundaries and then halves each side of the boundary until the boundaries are narrow enough to find a solution. Then it moves onto the next attribute and repeats, after it optimizes them all it does another run through and another (to account for interdependence) until none of the parameters are significantly adjusted.

All this takes several hours to run at least. Still cool to see its working as it drops the error rate significantly and gets to the point where it makes fairly good predictions about how a stock is likely to change in the near future (the value measuring the error against)... in fact i'm amazed just how powerful an accurate this algorithm is at predicting stocks right now.

@Science

@pganssle Just an FYI, now that I am past some of the multiprocessing headaches and found some easier workarounds that isnt as convoluted as my earlier attempts I can say that while still not my favorite WRT multiprocessing it is a lot more pleasant than my early experiences.

@admin The thing is long term trends are easier to predict for us humans because they tend to be based on actual company performance, short term trends are effected by impulsive human behavior to news or events.

As such while short term trading will always show you the greatest ROI (or the fastest loss), for more people long term trading, since they can predict it better, will tend to cause them to gain money slowly where short term trading will cause them to lose money quickly. A big part of the reason is that very impulsivity you just described and my algorithm is the cool collected logical one at the other side ready to make a win on your panic :)

@admin the algorithm doesnt determine the state of the overall market so it wouldnt tell me if the whole market is crashing or not. Though I could stick it on an index like TQQQ and it will tell you if its crashing sorta indirectly (in fact I use TQQQ a lot for my benchmarks and trading).

Thing is the algorithm is not trying to predict long term trends, thats not a good way to make money. It is trying to predict short term trends. It only cares where it should put money into for the next few hours and should that change it will change where the money goes. It doesnt care what will happen a year from now.

@kirschwipfel Thank you! when i come around again and am ready to address this issue (I shelved it for a much simpler approach that is 90% as good) I certainly will. Good to know they are out there.

@hansw

Very soon it looks like. My personal income (algo trading) has taken priority as i really need tog et this fully automated. But i literally just finished what I think/hope is the final feature/fix to make that possible (until now ive had to trade manually as i code from alarms from the algo).. once i have that up and trading live, which should be in the next few days I can do a round on QOTO.

@Gargron

@FailForward

Hahah, very true, length is actually relative.

Good conversation, look forward to the next one.

@timorl @2ck

@FailForward

> You seem to be a physicist

Nah, not a physicist at all, though I do have RF EE background which has some deep physics roots. But I would not call myself a Physicist.

> My vector of challenge is that you do not have that fulcrum, that fixed point you need so that you can use happiness as an objective measure. I claim that it is a relative measure (this is more happiness than that), not an absolute one.

Sadly I do not have the time or energy right now to invest in your entire post or the discussion, its a busy day. But I do want to comment on this one point as I was thinking about it all night as I slept.

I strongly disagree with the idea that happiness is not an absolute quality and lacks a fulcrum point. I suspect what you are confusing it for is an unbounded, yet absolute, quality. that is there is always someone who can be more happy or less happy than you,a nd likewise you can adjust to your level of happiness to the point where it feels less rewarding than someone who just came out of a depression. But it is an absolute quality with a fixed "fulcrum point" as you put it.

I would express this assertion by the simple fact that we all know and easily identify (I would think, at least I feel I can) what that 0 point is. There is sadness (negative happiness), there is happiness (positive) and then there is feeling nothing, neither happiness or sadness, this is the 0 point. If i am in an emotionless state at the moment I dont think i could ever confuse this for happiness or sadness due to a relative comparison with a prior state or someone else. If i have no emotional stance at the moment but am in an environment where everyone is sad, I wouldnt say "I feel happy", I would still be fixed at 0 with no emotions.

I think the problem is just that the language is nondescript when it comes to this. If i say "I am very happy" this may mean something very different for someone who is usually depressed (as a little happiness feels like a lot) than someone who is normally happy.

This doesnt mean that happiness is not absolute, it just means that at present time we lack the physical tools to measure it quantitatively, we lack the ruler for happiness. But just because you lack the ruler doesnt mean that length is relative, nor does it mean happiness is relative. I would imagine if an MRI were sufficiently advanced to measure neurotransmitters accurately, and our understanding of that were advanced enough to determine a persons happiness from an MRI scan (which we are getting surprisingly close to doing) then we could measure happiness in very specific quantitative terms.

@timorl @2ck

@musingsole Largely because python offers a suit of tools that make the peripheral work much easier. All the greatest algorithmic trading tools appeared to be in python.

That said python can (as I recently did) acheive the performance, its not incapable of it. It just makes the process more painful than it needs to be in other languages.. even another high level language that allows for easier shared variables between threads would have solved the problem.

The idea that C is noticeably more performant is a bit of a myth. I code in C often and there are many good reasons to pick C, namely low level access to hardware, and it is the more direct and natural way to do GPGPU for certain types of algorithms... but outside of those two points it really isnt something I would pick for performance reasons as you really arent going to see any noticeable performance gain from C over many other high level languages **if** you code it right.

@FailForward

Yes, I've stated what that is twice.. Good is that which produces net happiness over time, bad is what produces net sadness over time.. Morality is acting on good things and avoiding bad.

Ergo if I can look back on an act and see it produced happiness in the world, then I can claim it is objectively moral.

To go back to the example of explaining slavery to a roman commander, I can with certainty assert that when slavery is legal the net sadness this produces is significant but due to the extreme suffering of the slaves, as well as the callousness for life and harshness it promotes in its master (which pours out and effects other people and generally promotes a world where there is little value for life even outside of slavery and thus much sadness is produced).

Therefore the objective measure I have of good and bad would show that even though in roman times the vast majority might disagree with me on the fact that slavery is immoral, the objective measure of morality I defined shows otherwise.

@timorl @2ck

@FailForward

> Clearly I am bound to lose this . Still… We might learn something.

I suspect this is a joke, or at least in jest (a half joke). But just to be clear I never consider these sorts of discussions about winning, even if I might feel my stance is unlikely to change without some strong arguments, it is still about exploring my view and yours and seeing what each of us can take away from that, if anything.

> I also believe there is a handful of principles humans deem universally moral/proper

I think this wording is problematic, and at a minimum it doesn't really represent what I was trying to say with my last rebuttal. There is almost nothing, no opinions on anything (and that includes opinions of facts) that are universal when it comes to humans. We cant even agree the earth is round in today's day and age with all the evidence we have. Sure we like to think all the humans agree o it and that flat earthers are some extreme minority. But the truth is people with very different opinions from each other tend to drive each other away, or just cause people to suppress those views. They are far more common than you think. I am shocked how often I come across them or the people ive seen on my timeline for years who turn out to be one but just never said so (due to the ridicule they get)

If we cant even agree on the earth being round there is very little, I'd go so far as to say nothing at all, that is universal about human opinions.

In fact it is quite possible that whatever the true objective morality is, it may very well not be particularly popular at all, let alone universal. But it doesnt make it any less true.

> Putting that aside, the question whether there is such a thing as universal moral principles is not a thing humanity as a whole did satisfactorily solve

I solved it :) The only thing I havent been able to do is to convince you and everyone else of that. Of course I half joke, it is certainly true that should there be a objective moral truth it is clear that we have not reached a majority consensus on what that is, so on this we agree.

> Morality is about deciding whether some human act, thought, or principle is deemed good (proper) or bad (improper). And a pure observation of humankind tells us that we quite differ in these judgements.

Again I agree on this point (though I would not use proper and improper to mean the same as good and bad, but thats not core to your point).

> Whether Earth is flat or not is not a question of “good” or “bad” (proper vs. improper) behaviour but of what we can satisfactorily prove to be the case or not in physical reality.

This example was not given to be an example of morality, it was given to show that even when we have more than enough evidence to accurately determine objective truth, you will still find humans are in disagreement about it in large numbers.

As for the earth being round being provable (falsifiable being the technical term), I think we both agree that it is. But by the same token go back just a few hundred years and it was no longer provable with the technology of the time. Yes you hear of early scholars measuring its circumference, and the techniques they provided to do that certainly was evidence in favor of the earth being round. But to understand the time period there were also other experiments that even today seem perfectly reasonable that suggested the earth was flat. It wasnt until our scientific understanding advanced far enough to understand why those experiments were incorrect that we could truely prove the earth was round. so while even though, at the time, it was not able to be proven it was none the less falsifiable, objective, and provable at a later date. More importantly though the scholars at the time with limited evidence were able to argue to that the earth was round, use evidence to do so, and while they couldnt prove it or be in the majority they were right and their perspective.

The point here is that the fact that no one could agree that the world was round, lack of universality, didnt make a lick of difference on either 1) the importance of aruring for the truth even when they were a minority voice or 2) the actual fact that they were right.

> Maybe I am missing something, but you are saying that 1) judgement whether something is “proper”/”improper” behaviour is actually objectively decidable; and at the same time

proper and improper was your wording, wording I rejected early on and already provided an objective definition of good and bad.. good and bad is quantified by the overall happiness over time that an action creates in the world. In other words, if you literally scanned everyone's brain and looked at how happy everyone feels, and average that out over time then you are measuring the amount of good in the world, and since it is measurable and tangible it is an objective measurement.

> 2) except for a relatively narrow set of quite extreme behaviours (murder and such), humans (at least so far) did not find a way how to agree on how to objectively decide it.

this point would seem apparent and obvious. People obviously disagree on what is good and bad, just as people disagree on other objective truths like if the earth is round.. but people disagreeing really has no bearing on the purpose of this discussion (exploring what **ought** to be, not what is).

> Technically, Biden had very little “effect” on history so far (if we omit his previous political acts) as his window of opportunity to have any effect started just a few hours ago. We’ll see.

Same can be said of Trump, if we omit his previous political acts to date Trump has had very little effect on humanity in the past day as well.. not sure why that is relevant, obviously we can and **should** consider both their past political pasts and I see no reason to limit the scope to the last 24 hours as both have had significant time to exercise political power in their respective histories.

> You seem to be forgetting that a societal consensus of what is proper and what is not changes.

I am not forgetting it, I never said or invoked anything about what is proper, you did, and as far as the definitions I already laid out when I first used the terminology of good and bad then what is proper has no relevance or relation to anything I said, as that is not what I said those words meant.

> I’d probably have a good time watching you explaining how slavery is a bad thing to a Roman senator some 2000 years ago, or to a Greek before that.

I would likely have a tremendously difficult time explaining it to them, and in fact most people would likely disagree with me. Though how many people agree with me has absolutely no bearing on the fact that I would, all the same, be correct. Just as someone arguing the earth was round to a roman senator, even if they wouldnt agree, would be all the same correct.

> What is deemed proper today, might be deemed improper 100 years from now.

Of course, but what is "proper" has no relevance to what is "good" or "moral" so that is a moot point.

> There is an element of universality to these things (protection of life, etc.), but most of it is a social agreement existing in a given time and space.

If by universiality you mean "lots of people agree" then no, not really. There are tons of people who do not feel protection of all life is a is a good thing... If by universiality you mean what is objectively good regardless of how many people recognize it or not, then I'd say yes, all things that are good or bad are objectively so (see my earlier objective measure of it).

> From my pov, exactly because we cannot decide what is good or bad explicitly.

We can, I already did decide, and I gave an objective measure for it. If you or anyone else chooses not to agree with me, that's fine, from my perspective that just means you are unable to recognize a clear and obvious (to me) objective truth about morality.. but from my POV the objective more truth is all the same there regardless of you or anyone else not being able to agree on it.

@timorl @2ck

Show older
CleverLibre Social

CleverLibre Social is an inclusive social instance for open discussion, learning, and community.
All cultures welcome.
Hate speech and harassment strictly forbidden.