OPINION OF THE COURT
In this appeal we are called upon to decide whether a federal cause of action should be implied to permit a plaintiff to sue an employee of the Internal Revenue Service (“IRS”) for damages resulting from a constitutional violation claimed to have occurred in connection with the assessment of a tax liability.
1
We will affirm the order of the District Court dismissing Shreiber’s complaint for failure to state a claim. In so doing, we join a number of other courts of appeals holding that a damages remedy should not be inferred against an IRS agent pursuant to
Bivens v. Six Unknown Federal Narcotics Agents,
In 1995 and 1996, IRS agent Mastro-giovanni conducted an audit of the federal income tax liabilities of Shreiber and his wife for the 1991, 1992 and 1993 tax years. During the investigation, Shreiber spoke with Mastrogiovanni on several occasions and became familiar with Mastrogiovanni’s voice. Shreiber alleges that on August 11, 1995, Mastrogiovanni left a voice mail message at his place of business stating in part: “Hey you Jew bastard piece of shit. This is White Trash, I am going to get you.” Thereafter, when the audit was completed, the IRS sent a “30-day letter” to the Shreibers, dated May 31, 1996, proposing large increases in their tax liabilities for the years 1991, 1992 and 1993. The letter was prepared by J.J. Jennings, District Director, on the basis of Mastro-giovanni’s recommendation.
Shreiber filed a timely protest of the adjustment with the IRS, and proceeded to contest it through administrative channels. It appears that he reached a tentative settlement with the IRS in June of 1999, in which the IRS agreed to reduce the amount of deductions it would deny and agreed to an adjusted amount due.
On May 29, 1998, while the administrative appeal was pending, Shreiber filed a civil rights action against Mastrogiovanni and the IRS. Shreiber’s complaint alleges that he was “denied his constitutional right *150 to a fair hearing due to the religious discrimination of the IRS agent,” evidenced by the voice mail message, and “deprived of property without due process of law, in violation of his Fifth Amendment rights.” In his appellate briefs, Shreiber extends his complaint to encompass an equal protection violation based on religion and grounded in the Fifth Amendment. He requests damages compensating him for his attorney’s fees and mental anguish as well as punitive damages. The government filed a motion for summary judgment, which the District Court actually treated as a motion to dismiss.
The District Court dismissed the complaint on two grounds. First, the District Court determined that Shreiber could not state a claim upon which relief could be granted. The District Court explained that Shreiber had conceded that 26 U.S.C. § 7433 was limited to redressing violations of the Internal Revenue Code and, thus, did not provide him with a cause of action. The Court then considered whether a
Bivens
remedy should be inferred. Reviewing the Supreme Court’s decision in
Bivens,
and its progeny, including
Schweiker v. Chilicky,
Shreiber contends that we should infer a cause of action under Bivens precisely because Congress did not provide one when it enacted 26 U.S.C. § 7433, and because, without a federal damages action, he will be without a meaningful remedy in the form of compensatory and punitive damages and unconstitutional behavior will not be deterred. At oral argument, Shreiber emphasized that his case should be distinguished from Schweiker and the other tax cases resolved in the government’s favor by other courts because he is contending that his constitutional rights were violated on the basis of religious animus.
An understanding of the applicable statutes and their history is important to understanding this appeal. In 1988, as part of the “Taxpayer Bill of Rights,” Congress enacted 26 U.S.C. § 7433, providing for a federal cause of action against an officer or employee of the IRS for actions in violation of the Internal Revenue Code or regulations “in connection with any collection of Federal tax.” 26 U.S.C. § 7433(a). 3 As enacted, § 7433(a) is the “exclusive remedy for recovering damages resulting from such actions.” Id. A proposed draft of the provision contained broader language. The draft permitted civil actions “in connection with any determination or collection of federal tax” and in violation of “any provisions of federal law.” S. 2223, 100th Cong., 2d Sess. § 123 (1988) (emphasis added). The Conference Report regarding § 7433 discusses two modifications from the Senate draft that are relevant to the *151 issue before us. The Report explains that the final version was:
limited to reckless or intentional disregard in connection with the collection of tax. An action under this provision may not be based on alleged reckless or intentional disregard in connection with the determination of tax.... [T]he provision is limited to reckless or intentional disregard of the Internal Revenue Code and the regulations thereunder. An action may not be brought under this provision based on an alleged violation of a Federal law other than the Internal Revenue Code or a regulation promulgated thereunder.
H.R. Conf. Rep. No. 100-1104, at 229 (1988),
reprinted in
1988-
Even though § 7433 was narrowed in scope during the drafting process, Congress has provided other methods by which a taxpayer can challenge an assessment. See 26 C.F.R. § 601.103(c) (explaining options available to a taxpayer). A taxpayer may pursue an internal appeal with the IRS, see 26 C.F.R. § 106, sue for a refund in federal court, see 28 U.S.C. § 1346(a)(1), 26 U.S.C. §§ 6511, 7422, or appeal the assessment to the Tax Court, see 26 U.S.C. §§ 6213, 6214. Attorney’s fees may be recovered in certain circumstances when the taxpayer is successful. See 26 U.S.C. § 7430. As noted, Shreiber utilized the administrative appeals process.
In determining whether Shreiber’s claim can be asserted against Mastrogiovanni in a civil rights action, we must consult the relevant precedent beginning with the seminal case of
Bivens v. Six Unknown Federal Narcotics Agents.
In
Bivens,
the Supreme Court held that an individual complaining of a Fourth Amendment violation by federal officers acting under color of their authority may bring a suit for money damages against the officers in federal court.
See Bivens,
Following
Bivens,
the Supreme Court has considered the availability of damages remedies under
Bivens
in a number of factual settings, and addressed the meaning of “special factors counseling hesitation.”
5
The Court’s decision in
Schweik
*152
er
is particularly relevant to our discussion here. In
Schweiker,
the Supreme Court considered whether a damages remedy should be implied under
Bivens
for alleged due process violations in connection with the denial of Social Security benefits.
See Schweiker,
The Supreme Court held that no
Bivens
remedy should be implied. Reviewing the teachings of applicable precedent, the Court reaffirmed that the absence of statutory relief for a constitutional violation does not necessarily mean that courts should create a damages remedy against the officer responsible for the violation.
See id.
at 421-22,
In sum, the concept of “special factors counseling hesitation in the absence of affirmative action by Congress” has proved to include an appropriate judicial deference to indications that congressional inaction has not been inadvertent. When the design of a Government program suggests that Congress has provided what it considers adequate remedial mechanisms for constitutional violations that may occur in the course of its administration, we have not created additional Bivens remedies.
Id.
at 423,
Proceeding to discuss the merits of the appeal, the Court noted that the remedial structure did not provide the plaintiffs with the “complete relief’ that would be available by way of a
Bivens
suit,
see id.
at 424-25, 426-27,
Applying these considerations to the case at hand, we agree with the District Court that a Bivens action should not be inferred to permit suits against IRS agents accused of violating a taxpayer’s constitutional rights in the course of making a tax assessment. Rather than supporting Shreiber’s argument, the legislative history of 26 U.S.C. § 7433(a) indicates that Congress did not inadvertently fail to codify a cause of action for assessment conduct; rather, Congress deleted “determinations” — which would have included assessments — in passing the statutory provision. Moreover, Congress modified what was in draft form a remedy for violations of “federal law” and enacted instead a remedy for violations only of the IRS code and regulations. Congress chose to provide certain remedies, and not others, as part of the complex *153 statutory scheme which regulates the relationship between the IRS and taxpayers. We will not create a remedy where Congress has chosen not to.
Although Shreiber correctly argues that without a
Bivens
action he cannot recover completely,
Schweiker
explains that where Congress has provided meaningful remedies we should exercise extreme caution in creating additional relief. As with the administration of welfare benefits, the organization of the tax system, and the balancing of governmental efficiency and individual rights, is best left to Congress.
See id.
at 429,
We also believe Shreiber’s deterrence argument is similarly misplaced. Although deterrence is one of the aims of a
Bivens
action,
see FDIC v. Meyer,
We note that our holding in this case is supported by the decisions of a number of other Courts of Appeals that have concluded that a
Bivens
action should not be inferred against IRS agents.
See Fishburn v. Brown,
Shreiber also argues that this case should be distinguished from
Schweiker,
and the other decisions cited above, because it involves religious animus. However, Shreiber’s pleading complains essentially of a denial of a fair hearing which resulted in the wrongful
assessment
of his tax, and of the proximate effects of the IRS agent’s actions. He does not contend that his right to religious freedom was implicated; rather, he cites the evidence of religious animus in support of his allegations that he was denied his Fifth Amendment right to due process and equal protection.
7
As he explained during oral argument, he would, however, have us hold that the type of unconstitutional act that leads to the incorrect assessment can alter the analysis of whether a
Bivens
action should be inferred. We do not find this argument convincing. Our focus at this time is not on the nature of the constitutional violation that led to the allegedly incorrect assessment — which the plaintiff must prove on the merits and we assume at this time — but whether it is appropriate to create a damages action to remedy the wrong in light of what Congress has done.
See Schweiker,
Bush v. Lucas
is particularly relevant to this aspect of Shreiber’s argument. In
Bush,
the Supreme Court held that a
Bivens
action should not be inferred to permit federal employees to sue their supervisors for alleged violations of their First Amendment rights “[bjecause such claims arise out of an employment relationship that is govei’ned by comprehensive procedural and substantive provisions giving meaningful remedies against the United States.”
Bush,
In
Schweiker,
the plaintiffs argued that a
Bivens
action should be inferred to provide them with additional remedies because they had been denied benefits for constitutional reasons.
See Schweiker,
In sum, Shreiber asks us to infer a federal damages remedy under
Bivens
for violation of his Fifth Amendment protections of due process and equal protection by an IRS agent charged with auditing his tax returns. We decline to do so because we believe that Congress’s efforts to govern the relationship between the taxpayer and the taxman indicate that Congress has provided what it considers to be adequate remedial mechanisms for wrongs that may occur in the course of this relationship.
See Schweiker,
For the reasons stated above, we will affirm.
Notes
. We have previously affirmed, without prece-dential effect, at least three district court rulings which have explained that a
Bivens
remedy should not be inferred for allegations of unconstitutional actions by IRS agents.
See Barnard v. Pavlish,
No. 97-CV-0236,
. The government does not rely upon this ground of dismissal on appeal. The government does argue that Shreiber failed to allege a cognizable constitutional violation, and that Mastrogiovanni is entitled to qualified immunity. In light of our disposition, we need not discuss these points.
. The statute currently states in full:
(a) In general. If, in connection with any collection of Federal tax with respect to a taxpayer, any officer or employee of the Internal Revenue Service recklessly or intentionally, or by reason of negligence, disregards any provision of this title, or any regulation promulgated under this title, such taxpayer may bring a civil action for damages against the United States in a district court of the United States. Except as provided in section 7432, such civil action shall be the exclusive remedy for recovering damages resulting from such actions.
26 U.S.C. § 7433(a).
. Since its enactment in 1988, Congress has amended § 7433. For instance, in 1998, Congress amended the provision to permit suits based upon allegations of negligence in the collection of taxes. See Pub.L. No. 105— 206, § 3102(a), (c).
. See
Schweiker,
. Under the applicable statute and regulations, Bagóla received compensation for his lost wages. See id. at 634. In addition, within forty-five days of his release from prison, he could apply for compensation for his injury in a no-fault proceeding. See id. at 634, 634 n. 2. The Seventh Circuit found the remedy to be lacking in deterrent value because of the potentially long delay and the possibility that the defendants' alleged conduct would not be relevant to the claim evaluation process. See id. at 644.
. We note that portions of Shreiber’s complaint allege injuries caused in part by the comments left on his voice mail. However, Shreiber candidly states in his brief that he “does not contend that the telephone message left by the IRS agent Mastrogiovanni was the violation of Appellant's constitutional rights, but instead is evidence of the agent's religious discrimination against Appellant." Appellant’s Br. at 8. Even if Shreiber had alleged the comments as a separate cause of action, the comments would not necessarily establish a constitutional violation.
See, e.g., Emmons v. McLaughlin,
