Rejoice in the Lord, ye righteous - See the notes at Psalm 33:1.
And give thanks at the remembrance of his holiness - Margin, "to the memorial" (compare Psalm 30:4). The idea is, "to the memory of his holiness;" that is, when his holiness comes before the mind; when it is remembered; when it is thought of. Give thanks or rejoice,
(a) that God is holy; that he is of purer eyes than to behold iniquity; that there is One eternally pure who presides over the universe; that there is One who will always do what is right;
(b) that such a Being is our God - our covenant-keeping God; that we may look to him, trust in him, enjoy him.
Wicked people do not rejoice that there is a God at all, and especially that God is a "holy God;" but it is one of the characteristics of true piety to rejoice in the thought that there is a God, and that he is perfectly holy, and hence, to feel conscious happiness whenever his name is mentioned, and whenever his attributes are referred to. The highest source of joy for man is that there is a God, and that God is exactly what he is, pure and holy. It would be a source of deepest sorrow if there were no God, or if God were in any respect, even the slightest, a different being from what he is.

Rejoice in the Lord, ye righteous - It is your privilege to be happy. Exult in him through whom ye have received the atonement. Rejoice; but let it be in the Lord. All other joy is the mirth of fools, which is as the crackling of thorns under a pot - it is a luminous blaze for a moment, and leaves nothing but smoke and ashes behind.
At the remembrance of his holiness - But why should you give thanks at the remembrance that God is holy? Because he has said, Be ye holy; for I am holy: and in holiness alone true happiness is to be found. As he, therefore, who hath called you is holy; so be ye holy in all manner of conversation. False Christians hate the doctrine of Christian holiness; they are willing to be holy in another, but not holy in themselves. There is too much cross-bearing and self-denial in the doctrine of holiness for them. A perfect heart they neither expect nor wish.
The analysis considers the whole Psalm as relating to Jesus Christ and the last judgment: so it was understood by several of the ancient fathers. The reader may take it in either sense.

Rejoice in the LORD, ye righteous; and give thanks at the (k) remembrance of his holiness.
(k) Be mindful of his benefits and only trust in his defence.

Rejoice in the Lord, ye righteous,.... In the word of the Lord, as the Targum; in Christ, the essential Word, in his person, the greatness, glory, and fulness of it; in his righteousness, and in salvation by him, and that always; see Philippians 4:4,
and give thanks at the remembrance of his holiness; of his essential holiness, as a divine Person, in which he is glorious, and which appears in all that he has done; and of the holiness of his nature and life, as man and Mediator, which are imputed to his people for their justification; and at the remembrance of that holiness which they have from him, and are made partakers of in sanctification: and at the remembrance of that perfect holiness which they shall have with him in heaven to all eternity. Holiness may also signify his faithfulness in the discharge of his work and office as Mediator, and in the fulfilment of his promises to his people; See Gill on Psalm 30:4.