format: text

text:
# Weak homology of elliptical galaxies

## 1 Introduction

In the three-dimensional space of observed parameters $`\mathrm{log}\sigma _0`$, $`\mathrm{log}R_\mathrm{e}`$, and $`SB_\mathrm{e}=2.5\mathrm{log}I_\mathrm{e}`$ (where $`I_\mathrm{e}=L/2\pi R_\mathrm{e}^2`$), early–type galaxies are approximately located on a plane, called the Fundamental Plane (hereafter FP; Dressler et al. 1987; Djorgovski & Davis 1987; Bender, Burstein, & Faber 1992), represented by the best–fit relation

$$\mathrm{log}R_\mathrm{e}=\alpha \mathrm{log}\sigma _0+\beta SB_\mathrm{e}+\gamma .$$
(1)
The central velocity dispersion $`\sigma _0`$ is often defined as the velocity dispersion referred to an aperture radius of $`R_\mathrm{e}/8`$ (Jørgensen, Franx, & Kjærgaard 1993); the quantities $`R_\mathrm{e}`$ and $`L`$ are the empirically determined half–luminosity (effective) radius and total absolute luminosity. The coefficients $`\alpha `$, $`\beta `$, and $`\gamma `$ depend slightly on the photometric band considered. By measuring $`R_\mathrm{e}`$ in kpc, $`\sigma _0`$ in km s-1, and $`SB_\mathrm{e}=42.05212.5\mathrm{log}(L/2\pi R_\mathrm{e}^2)`$ in mag/arc sec2, where $`L`$ is expressed in units of the solar Blue luminosity, reported values are $`\alpha =1.25\pm 0.1`$, $`\beta =0.32\pm 0.03`$, $`\gamma =8.895`$ (Jørgensen, Franx, & Kjærgaard 1993; Bender et al. 1998; note that these coefficients, in particular this choice of $`\gamma `$, refer to a long cosmological distance scale). The FP is characterized by a small scatter in $`R_\mathrm{e}`$, on the order of 15%, remarkably independent of the position on the FP itself.

Studies of the FP of early-type galaxies, from low to intermediate redshifts (for this latter case, see van Dokkum & Franx 1996; Kelson et al. 1997; van Dokkum et al. 1998a,b; Bender et al. 1998; Pahre, de Carvalho, & Djorgovski 1998; Pahre, Djorgovski, & de Carvalho 1998; Jørgensen et al. 1999; Treu et al. 1999; Kelson et al. 2000a,b,c; Treu et al. 2001a,b), are generally carried out under the guiding principle that the FP reflects the existence of an underlying mass–luminosity relation for such galaxies (see Faber et al. 1987; van Albada, Bertin, & Stiavelli 1995), in a scenario where galaxies are homologous systems in dynamical equilibrium. According to this simplified picture, galaxies are thought to be characterized by a universal internal structure (density and pressure tensor distributions), which differs from galaxy to galaxy only in terms of the relevant scales. An empirical indication that this may be the case is suggested by the fact that, on the large scale, the luminosity profile of elliptical galaxies appears to be universal.

The empirical $`R^{1/4}`$ luminosity “law” (de Vaucouleurs 1948) has long been recognized to fit the surface brightness profiles of elliptical galaxies successfully, to the point that, in the absence of other (spectroscopic) indicators, elliptical galaxies are routinely identified by means of this characteristic photometric signature. In this sense, it might be argued that on the large scale elliptical galaxies are characterized by a universal luminosity profile and thus they are also likely to be dynamically homologous systems. In practice, if we exclude the central regions of the galaxy, generally affected by seeing or instrumental PSF and sometimes studied separately in view of the possible presence of a massive black hole, the overall $`R^{1/4}`$ fit is characterized by residuals typically of the order of $`0.10.2\mathrm{mag}/\mathrm{arc}\mathrm{sec}^2`$ (e.g., see de Vaucouleurs & Capaccioli 1979; Capaccioli 1987; de Carvalho & da Costa 1988; Capaccioli 1989; Burkert 1993). These deviations from the $`R^{1/4}`$ law, although small, are often larger than the typical observational errors involved. Interestingly, they are systematic and appear to correlate with the galaxy luminosity (Michard 1985; Schombert 1986; see additional comments in the following paragraph). In general, the surface brightness profile in the external regions is found to be flatter for more luminous galaxies.

A simple and popular way to model the systematic non–homology noted in the surface brightness distribution of early–type galaxies is to consider an $`R^{1/n}`$ luminosity profile, with $`n`$ a free parameter, as a generalization of the $`R^{1/4}`$ law (Sersic 1968; see also Davies et al. 1988; Capaccioli 1989; Caon, Capaccioli, & D’Onofrio 1993, hereafter CCD93; Young & Currie 1994; D’Onofrio, Capaccioli, & Caon 1994, hereafter DCC94; Prugniel & Simien 1997, hereafter PS97; Wadadekar, Robbason, & Kembhavi 1999). The $`R^{1/n}`$ “law” has been found to be a statistically convenient description to address some issues related to the FP of elliptical galaxies (see Graham et al. 1996; Ciotti, Lanzoni, & Renzini 1996; Graham & Colless 1997; Ciotti & Lanzoni 1997; Graham 1998). In addition, it has been applied to the description of the surface brightness profiles of galaxy bulges (see Andredakis, Peletier, & Balcells 1995; Courteau, De Jong, & Broeils 1996). On the theoretical side, it has been the focus of several general investigations (see, e.g., Makino, Akiyama, & Sugimoto 1990; Ciotti 1991; Gerbal et al. 1997; Andredakis 1998; Ciotti & Bertin 1999). If applicable, this description would bridge the gap between the classical $`R^{1/4}`$ profile and the exponential profile characteristic of disks. It has soon become clear that the shape parameter $`n`$ of the $`R^{1/n}`$ law correlates with global quantities such as total luminosity and effective radius (CCD93; PS97; see also Khosroshahi et al. 2000). For example, on a sample of 52 E/S0 galaxies with $`M_\mathrm{B}<17.3`$, CCD93 find the following relation:

$$\mathrm{log}n=0.28+0.52\mathrm{log}R_\mathrm{e}$$
(2)
with $`rms=0.18`$. Here $`n`$ is the best-fit value obtained by fitting the luminosity profile along the major axis, and $`R_\mathrm{e}`$ is determined from the curves of growth, independently of the fit procedure. CCD93 noted that the transition from normal to bright ellipticals occurs at $`n=4`$, $`R_\mathrm{e}=3`$ kpc, while low–luminosity ellipticals (Davies et al. 1983) are characterized by $`n1`$. The above relation implies the existence of a similar relation between $`n`$ and $`M_\mathrm{B}`$, since $`R_\mathrm{e}`$ and $`M_\mathrm{B}`$ correlate with each other. For example, CCD93 and DCC94 found:

$$n=19.0821.211M_\mathrm{B}19.082+3.0275\mathrm{log}L.$$
(3)
The average scatter around this relation turns out to be $`\mathrm{\Delta }n1.895`$, but the effective scatter increases significantly with $`L`$.

Some confusion has accompanied the application of the $`R^{1/n}`$ models to observed objects. For example, PS97 report the correlations $`nR_\mathrm{e}`$ and $`nM_\mathrm{B}`$ for a broad sample of ellipticals; but here, in contrast with CCD93, the correlations are shown to saturate, for $`\mathrm{log}R_\mathrm{e}[\mathrm{kpc}]>0.8`$ and $`M_\mathrm{B}<20`$, to values of $`n`$ close to 4. The apparent discrepancy is to be traced to the fitting procedure used. In fact, PS97 referred to the curves of growth (see comments in Appendix B.1 below). As a result, for a given sample of early–type galaxies, values of $`n`$ not larger than 6 have been claimed by PS97, based on the use of curves of growth, while values of $`n`$ up to 15 have been found (see CCD93; DCC94) based on direct profile fitting. Curiously, for the low-luminosity objects, where the latter procedure sets values of $`n`$ below 5, the two methods appear to be mutually consistent.

Another natural way to address systematic deviations from the $`R^{1/4}`$ law is to imagine (e.g., see Saglia et al. 1997) that the galaxy results from the superposition of an $`R^{1/4}`$ component (presumably spheroidal) and an exponential component (presumably flat). This latter procedure is appealing from the dynamical point of view (S0s are often thought to be made like this), yet the procedure is usually applied as a purely photometric method (with no check on its dynamical foundation; attempts in this latter direction have been made, see Scorza & Bender 1995).

In view of constructing a physical rationale at the basis of the FP, the existence of strict homology is not necessary (see Ciotti & Pellegrini 1992; CCD93; Renzini & Ciotti 1993; Djorgovski 1995; Capelato, de Carvalho & Carlberg 1995; Hjorth & Madsen 1995; Ciotti, Lanzoni, & Renzini 1996; PS97; Pahre & Djorgovski 1997; and references therein). In fact, many of the arguments that allow for a physical interpretation of the observed scaling law would carry through even in the case that we may call of weak homology. This is a condition by which the structure and dynamics (density and pressure tensor distributions) of early–type galaxies vary systematically with galaxy luminosity. An indication that this may be a realistic picture is indeed provided by the systematic trends noted above in terms of $`R^{1/n}`$ fits. However, we should emphasize that, based on the photometric properties alone of early–type galaxies, we cannot draw conclusions about the FP. For this latter goal we have to make use of dynamical models, because we need to translate the trends observed in the photometric profiles into trends of the relevant coefficients entering the virial theorem. The models used must at least be generally consistent with the available kinematical properties of early-type galaxies, otherwise the consequences drawn would be based on unjustified models. An interesting attempt at combining photometric and kinematic information towards a comprehensive interpretation of the FP has been made recently by Gerhard et al. (2001). However, their detailed dynamical investigation of a sample of 21 galaxies is far from being conclusive, because their sample is mostly biased in the direction of luminous objects and because their kinematical measurements, although based on the sophisticated technique of fitting line profiles, are admittedly subject to significant model limitations and large uncertainties.

We should emphasize that observations already provide important empirical evidence both against strict homology and against the constant stellar mass–to–light ratio hypothesis. On the one hand, the existence of a relation such as that given in Eq. (3) and the fact that trends in the dark matter content with luminosity are noted readily argue against strict homology. On the other hand, the existence of clear correlations involving the galaxy luminosity, such as the color-luminosity relation, and the fact that the coefficients that define the FP depend on the observed waveband suggest that systematic changes in the underlying stellar populations are involved. At the interpretation level, an explanation based on a pure age-luminosity relation is not viable, because it is hard to reconcile with the small and approximately uniform scatter of the FP at zero redshift and because it turns out to be incompatible with the observed properties of the FP at intermediate redshifts. In addition, it has been shown that interpretations based solely on either a dark matter-luminosity relation or a metallicity-luminosity relation or a systematic change of the Initial Mass Function with luminosity are not satisfactory because they do not survive a close scrutiny. In this paper we will add further internal consistency to the arguments in favor of a form of weak homology at the basis of the FP.

In Section 2 we carry out an in–depth analysis of 4 significant cases of deviations from the $`R^{1/4}`$ law by analyzing the surface brightness profiles of NGC 1379, NGC 4374, NGC 4458, and NGC 4552. We will confirm that a generic $`R^{1/n}`$ law, with $`n`$ a free parameter, can provide superior fits (the best-fit value of $`n`$ can be lower than 2.5 or higher than 10), better than those that can be obtained by a pure $`R^{1/4}`$ law, by an $`R^{1/4}`$+exponential model, and by other dynamically justified self–consistent models. Although it may be argued that four galaxies are a sample of little statistical significance, the detailed tests that we have performed on these otherwise normal objects and, especially, the systematic trends with luminosity noted in the literature for large samples (see Eq. (3), based on a sample of 52 galaxies) provide convincing evidence that homology cannot be considered a strict rule for early–type galaxies.

In Section 3 we focus on the main implications of these conclusions on the problem of the tilt and the thickness of the FP. For a constant (from galaxy to galaxy) stellar mass–to–light ratio a suitable correlation $`n(L)`$ could be consistent with the observed FP. We demonstrate that this statement may be true even in the presence of significant scatter in the correlation $`n(L)`$, by means of a general mapping procedure from the space of the intrinsic physical model quantities to the space of observed quantities. We also show that, in principle, in the absence of strong empirical constraints on the correlation $`n(L)`$, the Fundamental Plane could be realized in an infinite number of ways, two of which are indeed the constant stellar mass–to–light solution, and the strict $`R^{1/4}`$ homology solution combined with a suitable mass–luminosity relation. Actually, indications provided by a set of “data points” associated with a sample of 14 galaxies are shown to suggest that neither the strict homology nor the constant stellar mass–to–light solution are a satisfactory explanation of the observed Fundamental Plane.

In the concluding Section 4, we briefly address some interesting consequences on the expected trends of the observed FP at intermediate redshifts and outline some natural possible extensions of the work presented here.

Background work is recorded in the Appendices. Appendix A summarizes the properties of the models used in the fits presented in Section 2. Appendix B describes the relevant fitting procedures. Appendix C illustrates some properties of isotropic dynamical models in relation to the definition of the central velocity dispersion $`\sigma _0`$. Finally, Appendix D records the calculation of the virial coefficient associated with the dynamical models considered in this paper.

## 2 Deviations from the $`R^{1/4}`$ law

### 2.1 Preliminaries

Many studies have already addressed the issue of the universality of the $`R^{1/4}`$ law (e.g., see Burkert 1993; CCD93; DCC94; PS97; and references therein). In this paper we would like to focus on some relatively round objects, for which a significant departure from the $`R^{1/4}`$ law has been noted. These objects will be used as benchmark prototypes on which detailed tests will be performed about the quality of a number of photometric models, about various effects associated with the adopted fitting procedure, and about the role of the radial range over which the photometric fit is made.

In general, photometric profiles are compared with the $`R^{1/4}`$ law, or with other photometric models, only over a finite radial interval $`(R_{\mathrm{min}},R_{\mathrm{max}})`$. The inner limit is often taken so as to avoid a detailed discussion of the effects of seeing or instrumental PSF (the effects of the PSF on the observed surface brightness profile become negligible beyond a radial distance from the galaxy center of 2-3 times the scale of the relevant FWHM; e.g., see Bertin, Saglia, & Stiavelli 1988); furthermore, the innermost region of a galaxy may present features that are related to the presence of a massive central black hole, which is generally studied as a separate issue. The outer limit often reflects the quality of the available data, since special care has to be taken to properly subtract the contribution of the sky surface brightness (special techniques make it possible to measure reliable photometric profiles down to $`\mu _B2829\mathrm{mag}/\mathrm{arc}\mathrm{sec}^2`$). Of course, a correct estimate of the sky background is considerably more difficult in the case of galaxies with nearby companions.

Over a rather small radial range, a very good fit can be obtained rather easily and it is thus hard to discriminate among different models. For example, within the radial range $`0.1R_\mathrm{e}R1.5R_\mathrm{e}`$, the galaxies NGC 1379 and NGC 4374 are well fitted by the $`R^{1/4}`$ law. In fact, based on the definition of average residual

$$\mathrm{\Delta }\mu =\frac{1}{\sqrt{N}}\left\{\underset{i=1}{\overset{N}{}}[\mu _{1/4}(R_i)\mu _{\mathrm{obs}}(R_i)]^2\right\}^{1/2},$$
(4)
where $`N`$ is the number of photometric data points $`\mu _{\mathrm{obs}}`$ inside the radial range of the fit, and of maximum residual

$$(\mathrm{\Delta }\mu )_{\mathrm{max}}=\underset{R_{\mathrm{min}}R_iR_{\mathrm{max}}}{\mathrm{max}}\left|\mu _{1/4}(R_i)\mu _{\mathrm{obs}}(R_i)\right|,$$
(5)
the galaxies NGC 1379 and NGC 4374 are found to be characterized by $`\mathrm{\Delta }\mu =0.033\mathrm{mag}/\mathrm{arc}\mathrm{sec}^2`$, $`(\mathrm{\Delta }\mu )_{\mathrm{max}}=0.079\mathrm{mag}/\mathrm{arc}\mathrm{sec}^2`$ and by $`\mathrm{\Delta }\mu =0.052\mathrm{mag}/\mathrm{arc}\mathrm{sec}^2`$, $`(\mathrm{\Delta }\mu )_{\mathrm{max}}=0.108\mathrm{mag}/\mathrm{arc}\mathrm{sec}^2`$ respectively (Burkert 1993). As we will see, these results change significantly when the radial range of the fit is increased (but see Makino, Akiyama, & Sugimoto 1990).

### 2.2 The sample

In the following we consider four apparently round “prototypical objects”, NGC 1379, NGC 4374, NGC 4458, and NGC 4552, that are known to present significant deviations from the standard $`R^{1/4}`$ luminosity distribution. We refer to photometric data (in the Blue band) available in the literature, taken from Caon, Capaccioli, & Rampazzo (1990) and Caon, Capaccioli, & D’Onofrio (1994), that have pointed out the existence of a departure from the $`R^{1/4}`$ behavior. Indeed, we have selected the four galaxies, from the sample of 80 galaxies studied by these authors, based on the following criteria: (1) Round isophotes; (2) Radially extended available photometry; (3) Significant deviations from the $`R^{1/4}`$ law. At this stage, we are not interested in the small–scale behavior of the luminosity distribution at very small galactocentric radii and so we did not look up high–resolution data from more modern investigations (e.g., from HST; see Stiavelli et al. 2001), which would address issues beyond the goals of this paper. On purpose, the adopted criteria 1)-3) do not refer to any, possibly available, kinematical information on the four objects, because we whish to conform to the usual (i.e., purely photometric) selection rules adopted in the construction of early-type galaxy samples for studies of the FP.

For this set of objects we consider the relative performance of four different photometric models: (i) $`R^{1/n}`$ (one free dimensionless parameter: $`n`$), (ii) $`R^{1/4}`$ (no free parameters), (iii) $`R^{1/4}`$+exponential (two free parameters: $`L_{\mathrm{exp}}/L_{\mathrm{tot}}`$ and $`R_{\mathrm{exp}}/R_{1/4}`$), and (iv) $`f_{\mathrm{}}`$ models (one free parameter: $`\mathrm{\Psi }`$). The main properties of the models are summarized in Appendix A. In all cases, in addition to the best–fit values of the free dimensionless parameters, if available, the fitting procedure leads to the determination of two scales, i.e., of the model effective radius $`R_\mathrm{e}`$ and of the model total luminosity $`L`$.

Each of the four different photometric models is tested against a variety of options for the fitting procedure: (a) profile fitting or circularized profile fitting or curve of growth fitting, (b) reduced or extended radial range, and (c) constrained or unconstrained integrated luminosity. These fitting procedures are briefly described in Appendix B.

### 2.3 Relative performance of four photometric models for four prototypical objects

In Table 1 we record the results for the best-fit $`R^{1/n}`$ models, for the reference option of using circularized profiles, of considering the most extended radial range available, and of imposing no constraint on the integrated luminosity. The quality of the fit is measured by the parameter $`\chi ^2`$, defined in Appendix B, and is also described here by the values of $`\mathrm{\Delta }\mu `$ and $`(\mathrm{\Delta }\mu )_{\mathrm{max}}`$ (see Eqs. -). Some of the digits of the various entries are not significant, but we have decided to keep them since there should be no reason for misinterpretation. The last two columns record the surface brightness excursion available for the photometric data and the total absolute magnitude of each object. The best-fit $`R^{1/n}`$ models are then illustrated in Figs. 1 and 2.

Similarly, in Table 2 we summarize the corresponding performance of the other three photometric models (for the same option of fitting procedure as in Table 1). It is clear that, especially for the two objects (NGC 4374 and NGC 4552) that are characterized by high values of $`n`$, the model effective radii thus determined by the fit can vary dramatically (but see comments in Sect. 2.2). The fits are then illustrated in Figs. 3-5. For the low-$`n`$ galaxy NGC 1379, the $`f_{\mathrm{}}`$ models are not providing a satisfactory fit, which is not surprising since for this galaxy the role of rotation is likely to be important (see the kinematical profile recorded by Graham et al. 1998) and thus the galaxy falls outside the physical scenario at the basis of the models. In addition, two minima in $`\chi ^2`$ are actually available for the $`f_{\mathrm{}}`$ models for this galaxy: the higher $`\chi ^2`$ model (lower $`\mathrm{\Psi }`$; not illustrated in Fig. 5) is less bright than the galaxy in the central region (opposite to the behavior of the model fit shown in the Figure), both models are brighter than the galaxy at large radii.

In Table 3 we summarize the results of the best-fit $`R^{1/n}`$ models obtained under various fitting options. It is clear that many of the quantities thus derived are sensitive to the adopted fitting procedure. As an extreme example, we point to the case of NGC 4374, for which the best-fit model for the reduced radial range (case $`b`$ of Table 3) would be characterized by $`R_\mathrm{e}=1092`$ arcsec, so that most of the total luminosity of the galaxy would be assigned to the unobserved part of the photometric profile. Our results quantify and generally confirm trends already noted in earlier studies (see Introduction; but see also some important remarks in Appendix B.1).

For the set of four galaxies, considered to be as prototypes of objects with a genuine deviation from the $`R^{1/4}`$ law, we have found the following results. These are based on direct inspection of Figs. 1-5 and especially on comparison of the $`\chi ^2`$ values relative to the various fitting options in Table 1 and 2. For all galaxies the fit by a pure $`R^{1/4}`$ law is the worst, with significant residuals. For one galaxy (NGC 4458) the $`R^{1/4}`$+exponential model gives a marginally better fit with respect to the $`R^{1/n}`$ model ($`\chi ^2=0.74`$ vs. $`\chi ^2=0.85`$), but for this galaxy also the pure $`R^{1/4}`$ law and the $`f_{\mathrm{}}`$ models give reasonable fits ($`\chi ^2=1.13`$ and 0.71, respectively); not surprisingly, this is the galaxy with the smallest surface brightness excursion $`(\mu _{\mathrm{max}}\mu _{\mathrm{min}})`$ sampled by the available data (less than 5 magnitudes) and the one for which the best–fit value of $`n`$ ($`n3.2`$) is closest to the standard value of 4. For the three remaining galaxies (NGC 1379, NGC 4374, NGC 4552), for which the surface brightness profiles extend over a range of more than 7 magnitudes, the $`R^{1/n}`$ model definitely gives the best fit, even if it has fewer parameters than the $`R^{1/4}`$+exponential model. In addition, the two objects (NGC 4374 and NGC 4552) that turn out to be characterized by high values of $`n`$ (of order 10), when fitted by the $`R^{1/4}`$+exponential model, would lead to a disk component with an unusually high central brightness ($`18.2`$ and $`18.1`$ mag/arcsec2 in the Blue band, respectively), at variance with the central brightness of galaxy disks that characterize spiral galaxies. It would be interesting to check wheter this is a common feature of $`R^{1/4}`$ \+ exponential decompositions of early–type galaxies.

### 2.4 Robustness of a photometric indicator

In the discussion of the properties of the FP, it has often been noted (see Kelson et al. 2000a; Treu et al. 2001a; see also Trujillo, Graham, & Caon 2001) that much of our uncertainties in relation to the parameters derived by fitting the photometric profile is resolved by an unexpected circumstance, that is the empirical robustness of the photometric indicator that enters the FP with respect to the modeling procedure. The relevant indicator is

$$\varphi _{\mathrm{FP}}=\mathrm{log}R_\mathrm{e}\beta SB_\mathrm{e},$$
(6)
with $`\beta 0.32`$ (see Eq. (1) and following remarks).

An important point should be noted here. There are two different ways of considering possible variations of $`\varphi _{\mathrm{FP}}`$ for a given object, on the basis of the definition of $`SB_\mathrm{e}`$ reported just before Eq. (1). One is that of considering both $`R_\mathrm{e}`$ and $`L`$ as model quantities, both determined by the fit to the data (see the comments on the extreme case of NGC 4374 made at the end of the previous subsection). The other is to keep the total luminosity as fixed (for the set of four galaxies studied earlier in this paper, see the last column of Table 1), and let only $`R_\mathrm{e}`$ be determined by the fit. In this latter case, it is readily shown that the change in the value of the photometric indicator associated with a small change of $`R_\mathrm{e}`$ due to the modeling procedure is $`\delta \varphi _{\mathrm{FP}}=(15\beta )\mathrm{log}e\delta R_\mathrm{e}/R_\mathrm{e}0.26\delta R_\mathrm{e}/R_\mathrm{e}`$; this shows that the change in $`\varphi _{\mathrm{FP}}`$ is, in this case, systematically smaller than the relative change in $`R_\mathrm{e}`$. No matter which definition of $`\delta \varphi _{\mathrm{FP}}`$ we refer to, the impact of a variation in $`\varphi _{\mathrm{FP}}`$ on the FP itself can be quantified by stating that, if we call $``$ the ratio between the value of $`R_\mathrm{e}`$ predicted by the FP, at a given value of $`\sigma _0`$, and the observed value, then $`\delta /=\delta \varphi _{\mathrm{FP}}/\mathrm{log}e2.3\delta \varphi _{\mathrm{FP}}`$.

Here, based on the first definition of $`SB_\mathrm{e}`$ (for which $`L`$ is taken as a model quantity), we confirm the general validity of the statement. Surprisingly, the photometric indicator is robust both with respect to changes of the adopted photometric model (compare Table 1 and Table 2) and with respect to variations in the fitting procedure within the same photometric model (compare Table 1 and Table 3). Therefore, for the purpose of measuring the quantities entering the FP we are on safe grounds, whereas for the purpose of interpreting the FP we are left in a rather ambiguous situation.

### 2.5 The kinematical counterpart. Low-luminosity galaxies as a physically separate class of objects

The investigation provided earlier in this paper sheds some light on the issues of modeling and confirms that homology cannot be considered a strict rule for early–type galaxies. However, the discussion so far has been restricted to the photometric aspects, while the possibility of weak homology (i.e., of systematic trends in structural and dynamical properties as a function, e.g., of galaxy luminosity) should be assessed by considering the entire set of quantities that enter the FP. In particular, it is unavoidable that one should address the internal kinematical properties of the galaxies involved. In fact, it has long been known that low–luminosity ellipticals are likely to be rotation supported systems (Davies et al. 1983). If we are interested in drawing a connection between the low values of $`n`$ that best describe low–luminosity ellipticals and the dynamical coefficient that enters the virial theorem, we should not forget that the virial theorem relation reflects the entire dynamical structure of the system involved.

To be more specific, it is often argued that the relevant dynamical coefficient can be conveniently calculated under the simplifying assumption that the system be characterized by an $`R^{1/n}`$ profile in projection, while intrinsically the system be spherical, non-rotating, and strictly isotropic. From the Jeans equations such coefficient is determined in a straightforward manner (see PS97; Ciotti & Lanzoni 1997; see also Sect. 3 and Appendix D below). In practice, it remains quite doubtful that such coefficient can be usefully inserted into a realistic discussion of the FP, given the fact that the velocity dispersion profiles thus calculated are often qualitatively different from those observed (see Appendix C). Indeed, some of the difficulties that we may find in placing the four galaxies described in this section into the context of the FP, as will be attempted in Sect. 3 (in particular, see Figs. 6-9), may just be due to this basic modeling problem.

So far we may claim that we have a reasonable representation of the dynamical structure only of bright ellipticals, at least in the case of intrinsically fairly round objects (e.g., see Bertin & Stiavelli 1993). Low–luminosity ellipticals appear to be a physically separate class of objects. Until we gain, by systematic spectro–photometric surveys and by new and accurate modeling, a good picture of how early–type galaxies are structured, from faint to bright objects, there is no hope that we can make a reliable discussion of the impact of the observed deviations from the $`R^{1/4}`$ law on the FP. Nonetheless, in the absence of such comprehensive dynamical modeling, by using the one–component, spherical, non–rotating, isotropic $`R^{1/n}`$ models (even if we know them to be an inadequate representation) we will be able to demonstrate, in the next Section, that the absence of strict $`R^{1/4}`$ homology can be consistent with an entire spectrum of possible interpretations of the FP. Curiously, these interpretations may well hold even if the empirical relation $`n=n(L)`$ is affected by large scatter.

## 3 Impact on the Fundamental Plane

In order to assess the consequences of weak homology on the interpretation of the FP, below we follow a line of thought already introduced, e.g., by Ciotti & Pellegrini (1992).

For a stationary stellar system, the scalar virial theorem can be written as

$$\frac{G\mathrm{{\rm Y}}_{}L}{R_\mathrm{e}}=K_\mathrm{V}\sigma _0^2,$$
(7)
where the coefficient $`K_\mathrm{V}`$ takes into account projection effects, the specific star orbit distribution and the specific density distribution, and effects related to the presence of dark matter; here $`\mathrm{{\rm Y}}_{}`$ is the stellar mass–to–light ratio in the given band used for the determination of $`L`$ and $`R_\mathrm{e}`$. Equations (1) and (7) imply that in real galaxies, no matter how complex their structure is, the dimensionless factor $`\mathrm{{\rm Y}}_{}/K_\mathrm{V}`$ is a well-defined function of any two of the three observables $`(L,R_\mathrm{e},\sigma _0)`$. For example, by eliminating $`\sigma _0`$ from Eqs. (1) and (7) we obtain

$$\frac{\mathrm{{\rm Y}}_{}}{K_\mathrm{V}}R_\mathrm{e}^{(210\beta +\alpha )/\alpha }L^{(5\beta \alpha )/\alpha }.$$
(8)
This fact is remarkable by itself. All stellar systems described by Eq. (7) are in virial equilibrium, but only those stellar systems for which $`\mathrm{{\rm Y}}_{}/K_\mathrm{V}`$ scales according to Eq. (8) are placed onto the observational manifold given by Eq. (1). Of course, this requirement is only necessary for a model to describe real galaxies. In fact, the FP is not uniformly populated by galaxies; instead, observed stellar systems populate only a well-defined region of the FP.

After recalling two simple extreme interpretations of the FP (Subsection 3.1), in Subsection 3.2 we move to a more general exploration, which will bring out once more a problem of fine tuning met in the study of galaxies.

### 3.1 Two extreme interpretations of the Fundamental Plane

The possibility of simple extreme explanations of the FP is associated with the fact that the exponent of the effective radius appearing in Eq. (8) is observationally very small, i.e., $`(210\beta +\alpha )/\alpha 0.04`$ in the Blue band.

A first possibility to reproduce the scaling relation in Eq. (8) is then to assume homology (i.e., $`K_\mathrm{V}`$ identical for all galaxies), a variable stellar mass–to–light ratio (see, e.g., Renzini & Ciotti 1993; van Albada, Bertin, & Stiavelli 1995), and the empirically suggested identity $`210\beta +\alpha =0`$. With these assumptions we find

$$\mathrm{{\rm Y}}_{}L^\delta ;$$
(9)
here $`\delta =(2\alpha )/2\alpha 0.30\pm 0.064`$, where the scatter has been calculated by standard error propagation techniques. From a physical point of view, in a simple (coeval and single metallicity) monolithic formation, passive evolution scenario, a mass–luminosity relation for galaxies, of the kind suggested by Eq. (9), can result if, with significant fine tuning, the basic properties of the Initial Mass Function, which describes the origin of stellar populations, properly correlate with galaxy mass.

An alternative extreme explanation can be proposed by assuming a constant stellar mass–to–light ratio $`\mathrm{{\rm Y}}_{}`$ and the existence of weak homology (see Ciotti & Pellegrini 1992; CCD93; Renzini & Ciotti 1993; Djorgovski 1995; Hjorth & Madsen 1995; Ciotti, Lanzoni, & Renzini 1996; PS97; and references therein). In this case it is the quantity $`K_\mathrm{V}`$ (instead of $`\mathrm{{\rm Y}}_{}`$) that is required to be a well-defined function of $`R_\mathrm{e}`$ and $`L`$. If we take $`210\beta +\alpha =0`$, the required dependence is

$$K_\mathrm{V}L^\delta ,$$
(10)
with $`\delta `$ and its scatter the same as above. As noted in the Introduction, this latter interpretation is qualitatively encouraged by the observations. Quantitatively, we can easily show that we are in the right ballpark. In fact, from Eq. (10) it is realized that a factor of 20 in $`L`$, would require a change in $`K_\mathrm{V}`$ by a factor of $`2.45`$. If we consider one–component, spherical, non–rotating, isotropic $`R^{1/n}`$ models and a simulated spectroscopic aperture of $`R_\mathrm{e}/8`$, the relation $`K_\mathrm{V}(n)`$ can be computed (Ciotti & Lanzoni 1997; PS97; see Appendix D). An accurate and convenient analytical representation in the range $`1n10`$ (with typical errors on the order of one percent) is given by

$$K_\mathrm{V}(n)\frac{73.32}{10.465+(n0.94)^2}+0.954.$$
(11)
It is then demonstrated that the observed excursion in $`n`$ (see Sect. 2) could well be consistent with the desired range in $`K_\mathrm{V}`$. A similar argument also holds for the $`f_{\mathrm{}}`$ models, for which we have the following simple analytical interpolation formula, accurate to around one percent,

$$K_\mathrm{V}(\mathrm{\Psi })\frac{142.341.51\mathrm{\Psi }+2.66\mathrm{\Psi }^2}{30.6110.7\mathrm{\Psi }+\mathrm{\Psi }^2}$$
(12)
in the range $`2\mathrm{\Psi }10`$.

From this simple discussion we might conclude that weak homology of elliptical galaxies might indeed be consistent with a constant $`\mathrm{{\rm Y}}_{}`$ and the FP.

Unfortunately, the determination of the coefficient $`K_\mathrm{V}`$ is sensitive to the choice of models (see the expressions recorded above and App. D) and to the choice of the aperture radius. For the $`R^{1/n}`$ models, the latter dependence is not too significant, even in the presence of the well-known unrealistic central depression in their projected velocity dispersion profiles (see App. C); this has been checked by comparing the values of $`K_\mathrm{V}`$ obtained on the basis of an $`R_\mathrm{e}/10`$ aperture with those based on $`R_\mathrm{e}/8`$. In order to make a physically better justified case, one might think it more appropriate to refer to the $`f_{\mathrm{}}`$ models, which are known to possess realistic kinematical profiles. Note that this would lead to significantly different answers with respect to the application of $`R^{1/n}`$ models. For example (see App. D), if we take NGC 4552, the $`R^{1/n}`$ modeling would give $`n11.14`$ and $`K_\mathrm{V}1.6`$, while the $`f_{\mathrm{}}`$ modeling would set $`\mathrm{\Psi }6.2`$ and $`K_\mathrm{V}2.5`$; for the galaxy NGC 4458 (closest to the standard $`R^{1/4}`$ law in our sample), we find $`n3.2`$ and $`K_\mathrm{V}5.7`$ based on $`R^{1/n}`$ modeling or $`\mathrm{\Psi }9`$, $`K_\mathrm{V}3`$ based on $`f_{\mathrm{}}`$ modeling. Here we prefer not to pursue this line of investigation, because the empirical relation $`\mathrm{\Psi }=\mathrm{\Psi }(L)`$ has not yet been studied systematically and because, in any case, we know a priori that such modeling, even if it might turn out to be partially successful, would lack physical justification when applied to low–luminosity, rotation–supported galaxies.

### 3.2 A more general interpretation allowed by weak homology

We now describe a more general interpretation of the FP allowed by the existence of weak homology. For simplicity, we refer here to the family of $`R^{1/n}`$ models that has led to Eq. (11), although the method proposed could be implemented for any well–defined family of dynamical models. In particular, here we explore the theoretical manifold obtained by mapping, with the aid of Monte Carlo simulations, the model space $`(n,\mathrm{{\rm Y}}_{},L,R_\mathrm{e})`$ into the observed space $`(L,R_\mathrm{e},\sigma _0)`$. The domain of model galaxies considered in the simulations is defined by $`1\begin{array}{c}<\hfill \\ \hfill \end{array}R_\mathrm{e}\begin{array}{c}<\hfill \\ \hfill \end{array}20`$, $`0.1\begin{array}{c}<\hfill \\ \hfill \end{array}L\begin{array}{c}<\hfill \\ \hfill \end{array}50`$, and $`100\begin{array}{c}<\hfill \\ \hfill \end{array}\sigma _0\begin{array}{c}<\hfill \\ \hfill \end{array}350`$, where radii are measured in kpc, luminosities in $`10^{10}`$ solar Blue luminosities, and velocities in km s-1. For each four-dimensional point $`(n,\mathrm{{\rm Y}}_{},L,R_\mathrm{e})`$ in model space we calculate $`\sigma _0`$ from Eq. (7) and then we check if the mapped (virialized) system belongs to the FP. This allows us to select in model space, as acceptable candidates for real galaxies, only those points that turn out to be compatible, in the observed space, with the FP correlation and the observed scatter around Eq. (1). We also explore the “backbone” model manifold obtained by artificially reducing the FP thickness to a limiting zero–scatter case. For simplicity, we plot the projections of the manifold thus derived on the natural planes $`(L,\mathrm{{\rm Y}}_{})`$ and $`(L,n)`$, which are precisely the two planes that are used to illustrate the two extreme interpretations described in Subsection 3.1.

We start this exploration by applying the proposed technique to the two cases discussed in the previous subsection. The case of $`R^{1/4}`$ homology is studied by restricting the model population to a set of points for which $`3.99n4.01`$. The derived dependence of $`\mathrm{{\rm Y}}_{}`$ on $`L`$ is well fitted by the power law relation of Eq. (9), with $`\delta 0.27`$ (consistent with the value $`0.30\pm 0.064`$ argued in Subsection 3.1), with reduced $`\chi ^21.7`$. The scatter of points along the vertical axis at fixed $`L`$ (see Fig. 6) reflects the assumed thickness of the FP. Indeed, if we artificially reduce the scatter in $`R_\mathrm{e}`$ from 0.15 to 0.01, the derived power-law exponent becomes $`\delta =0.28`$, with reduced $`\chi ^27\times 10^2`$ (the thick locus of points in Fig. 6).

To illustrate the second case (see Fig. 7), we pick a constant stellar mass–to–light ratio $`3.49\mathrm{{\rm Y}}_{}3.51`$. The selected points are quite dispersed along the $`n`$ axis. A good fit is obtained by a law of the form $`n=a+b\mathrm{log}L`$, with $`b4.02`$ and $`\chi ^21.3`$, not so well in agreement with the observed scaling relation given in Eq. (3). After artificially reducing the scatter around the FP to 1 percent in $`R_\mathrm{e}`$, we now have $`b5.03`$ and $`\chi ^20.24`$. (By increasing or decreasing the reference value of $`\mathrm{{\rm Y}}_{}`$, the simulation points would move below or above the strip identified by the present choice of $`\mathrm{{\rm Y}}_{}`$.)

A somewhat unexpected result of these simple simulations is that the relatively small dispersion of $`R_\mathrm{e}`$ for real galaxies, around the value associated with the FP at any fixed $`L`$ and $`\sigma _0`$, is consistent with a significantly larger dispersion of the model parameters along the vertical axes in Figs. (6) and (7) at fixed values of $`L`$. Therefore, weak homology (e.g., a correlation between the structural parameter $`n`$ and the luminosity $`L`$) can be at the origin of a relatively thin FP, even in the presence of a substantial dispersion of $`n`$ at given $`L`$.

At this point we can proceed to consider the most general case, where neither homology is strict nor mass–to–light ratio is constant. In fact, we leave the model points to run over the entire ranges of $`\mathrm{{\rm Y}}_{}`$ values and $`n`$ values in the domain indicated at the beginning of this subsection. For simplicity, we look for the backbone manifold selected by artificially reducing the scatter on the observed $`R_\mathrm{e}`$ to 0.01. In this way the scatter presented by the points on the two natural planes $`(L,\mathrm{{\rm Y}}_{})`$ and $`(L,n)`$ will be determined only by projection effects (of the relevant manifold onto the desired planes).

In Fig. 8 we show the projection of what we have called the backbone manifold onto the $`(L,\mathrm{{\rm Y}}_{})`$ plane. Note how, at any given value of $`L`$, a larger range of $`\mathrm{{\rm Y}}_{}`$ values is permitted, even if the FP considered in the simulations is extremely thin. Therefore, in the general case, $`\mathrm{{\rm Y}}_{}`$ is not necessarily well correlated with galaxy luminosity, as a result of the presence of the free parameter $`n`$. It is interesting to check how models with different $`n`$ are distributed inside this projection of the backbone manifold; the open circles represent models characterized by $`3.8n4.8`$, a range slightly broader than that shown in the homology case shown in Fig. 6. In any case, also under the more general circumstances considered here, the FP relation is associated with an overall increasing trend for the stellar mass–to–light ratio $`\mathrm{{\rm Y}}_{}`$ with $`L`$.

Similar comments apply to the projection illustrated in Fig. 9. Here the open circles represent models with the stellar mass–to–light ratio $`\mathrm{{\rm Y}}_{}3.5`$. Note the large spread in $`n`$ present, still consistent with the existence of a thin FP, once the restriction of nearly constant $`\mathrm{{\rm Y}}_{}`$ is relaxed. Note also that there remains only a mild trend of $`n`$ with $`L`$ required by the existence of the FP, but only if we focus on the zero-scatter limit. Since in reality some correlation is observed (see Introduction and Eq. (3)), we should conclude that something else, in addition to the FP, characterizes the underlying weak homology of real galaxies.

### 3.3 Locating the four prototypical objects without detailed stellar dynamical modeling

With the aim of a better appreciation of the naive indications provided by a pure photometric modeling we have recorded, in Figs. 6-9, as open squares (labels $`a`$, $`b`$, $`c`$, $`d`$ following the order of Table 1), the points available for the set of four galaxies discussed in the previous part of the paper and from the available data about their central velocity dispersions. This information (see Table D.1), based on the $`R^{1/n}`$ modeling, allows us to extract values of $`\mathrm{{\rm Y}}_{}`$ from the observed values of $`\sigma _0`$ (119, 296, 106, and 269 km s-1 for NGC 1379, 4374, 4458, and 4552, respectively, McElroy 1995). In Fig. 6 and Fig. 8 we also record the different points that would be argued on the basis of a one-component $`f_{\mathrm{}}`$ photometric modeling.

For the purposes of this Section, the relevant quantities associated with the four galaxies are rescaled, when necessary, to the long cosmological distance scale. This is consistent with the adopted choice of coefficients for the FP (see Eq. (1) and following comments) and with the analysis to be presented in the following Subsection.

### 3.4 Trends from a sample of relatively bright galaxies and the role of dark matter

In order to better relate the arguments provided in this Section with the trends observed in real galaxies, we have included in Figs. 6 and 8 some “data-points” that are external to the simulations described above. These data-points have been obtained as follows.

We have referred back to the results of an ESO Key Programme “A search for dark matter in elliptical galaxies” and, in particular, to a set of 10 galaxies the properties of which are summarized in Table 5 of Bertin et al. (1994). The objects are: NGC 1399, NGC 3379, NGC 4374, NGC 4472, NGC 5812, NGC 5813, NGC 7507, NGC 7626, NGC 7796, and IC 4296 (some of these are also part of the sample considered by Gerhard et al. 2001). The numbers from 1 to 10 of the filled squares in Fig. 6 and Fig. 8 represent precisely these objects in the order followed above. These galaxies had been considered as those for which extensive and reliable stellar dynamical modeling was available, on the basis of accurate and radially extended stellar dynamical data. We borrow the values of $`\mathrm{{\rm Y}}_{}`$ and $`R_\mathrm{e}`$ listed in Table 5 of Bertin et al. (1994) under the columns $`(M_\mathrm{L}/L_\mathrm{B})_{2C}`$ and $`R_\mathrm{e}^m`$, respectively, and thus obtain the values of $`K_\mathrm{V}`$ for those objects, based on a detailed stellar dynamical modeling. One object, NGC 4374, is also part of the set of four galaxies for which we have re-examined the photometric profile in Sect. 2.

We note that those models did include significant amounts of dark matter. Therefore, it is not surprising to find now that several filled squares fall outside the strip outlined in Fig. 6, which has been calculated on the basis of strict $`R^{1/4}`$ homology. Then Fig. 8 shows that the same data-points are well consistent with a possible weak homology that is neither the strict $`R^{1/4}`$ homology nor the one based on a constant $`\mathrm{{\rm Y}}_{}`$. Note that the broad area outlined in Fig. 8 has been obtained by reducing artificially the scatter of the FP to 0.01.

## 4 Conclusions

This paper, organized in two parts, has led to a number of results, although many are the questions that remain only partly answered. Here we provide a summary of the main points made in the paper and of the most important questions that are left for future investigations.

In the first part of the paper we have re-examined the surface brightness profiles of NGC 1379, NGC 4374, NGC 4458, and NGC 4552, four galaxies that are known to present significant deviations from the $`R^{1/4}`$ law. We have considered the relative performance of four different photometric models, namely the $`R^{1/n}`$, $`R^{1/4}`$, $`R^{1/4}`$+exponential, and $`f_{\mathrm{}}`$ models. Each of the four different photometric models has been tested against a variety of options for the fitting procedure. We have thus reached the conclusion that there is indeed convincing evidence that homology cannot be considered a strict rule for early type galaxies. In particular, we have found that:

* For the four galaxies of this limited sample the fit by a pure $`R^{1/4}`$ law is the worst.
* For three objects the $`R^{1/n}`$ photometric model definitely provides the best fit, even better than that by the $`R^{1/4}`$+exponential model, although the latter model has the advantage of one additional free parameter.
* For NGC 4458, which is the object with the smallest surface brightness excursion available (less than five magnitudes), the $`R^{1/4}`$+exponential model gives a marginally better fit with respect to the $`R^{1/n}`$ model; but, for this, the $`R^{1/4}`$ and the $`f_{\mathrm{}}`$ models give practically equivalent fits.
* The $`f_{\mathrm{}}`$ models manage to provide a reasonable description of the bright ellipticals even when the $`R^{1/n}`$ modeling suggests a value of $`n`$ significantly larger than 4. However, they do not appear to be viable for the low-luminosity ellipticals, which are characterized by a small value of $`n`$. This does not come as a surprise, because the physical arguments that have led to the construction of the $`f_{\mathrm{}}`$ models reflect the picture of low rotation, collisionless collapse, while low-luminosity ellipticals are known to be generally rotation supported.
* The values of the effective radius resulting from the fit can change dramatically (by factors of up to three), depending on the fitting procedure and on the adopted photometric model. On the other hand, we confirm that the determination of the photometric indicator, i.e. the combination of photometric quantities entering the FP, is robust.

The good performance of the $`R^{1/n}`$ model in describing the photometric profiles of galaxies deviating from the $`R^{1/4}`$ law and the existence of an empirical correlation between $`n`$ and $`L`$ (see Eq. (3), based on a sample of 52 galaxies) suggest that elliptical galaxies might be considered as weakly homologous systems. Of course, a clear indication of weak homology cannot be based on photometric properties alone. In the second part of the paper, we have then addressed the impact of weak homology on the physical interpretation of the FP, starting from a re-discussion of the rationale behind two extreme interpretations of the tilt of the FP. One is obtained by assuming strict homology and a suitable relation between the stellar mass–to–light ratio and the galaxy luminosity. The other is obtained by taking a constant stellar mass–to–light ratio (from galaxy to galaxy) and a suitable form of weak homology. The latter interpretation usually raises concerns (besides the problems related to the interpretation of the observed correlations involving luminosity, such as the color-luminosity relation; see discussion in the Introduction), because the large scatter around the correlation $`n=n(L)`$ appears to be hard to reconcile with the small dispersion observed around the FP. We have thus obtained the following results:

* In order to address the problem in its generality, we have developed a systematic approach to the study of the FP, based on a mapping between model and observed quantities. For simplicity, we have used, as a guiding tool for the present investigation, simple one-component, spherically symmetric, isotropic $`R^{1/n}`$ models. The study would be best carried out with other families of models, better justified from the physical point of view, but for the present purposes the simple $`R^{1/n}`$ models used provide an adequate demonstration. The use of one-component models is equivalent to assuming that dark matter, if present, is distributed in direct proportion to the luminous matter.
* Within this framework, we have shown how the scatter of the stellar mass–to–light ratio (in the first of the two simplest interpretations) or of the index $`n`$ (in the second interpretation) is fully controlled by the observed thickness of the FP. This quantifies in detail the problem of parameter fine tuning that has to be faced.
* We have then relaxed the hypothesis of a simple (i.e., one-parameter) origin of the tilt of the FP and focused, for simplicity, on the structure of the FP with artificially reduced thickness. A fine tuning problem obviously remains, because the existence of the FP imposes a strict condition on $`\mathrm{{\rm Y}}_{}/K_\mathrm{V}`$. However, we have been able to demonstrate that the ranges of variation for the stellar mass–to–light ratio and the index $`n`$ of the models, at fixed galaxy luminosity, can be substantial and still be consistent with an arbitrarily thin FP. The fine tuning involved requires that variations in the stellar mass–to–light ratio be compensated for by corresponding variations in galaxy structure.
* Preliminary indications provided by a set of “data points” associated with a sample of 14 galaxies suggest that neither the strict homology nor the constant stellar mass–to–light solution are a satisfactory explanation of the observed Fundamental Plane.

This paper opens the way to the following new investigations, to be carried out in separate papers:

* A study based on the approach introduced in Sect. 3 within a more complex dynamical structure (presence of dark matter and more complicated geometries for the model galaxies).
* A study of the evolution of the FP with redshift, within a physical interpretation based on weak homology. If the observations were able to tell the time evolution of the coefficients $`\alpha `$ and $`\beta `$ in the exponents in Eq. (8), then, from our mapping procedure, we could infer the actual evolution shared between luminosity and structural parameters. From a different, predictive point of view, if we argue that the tilt of the FP is totally due to weak homology (with constant $`\mathrm{{\rm Y}}_{}`$ from galaxy to galaxy, so that the FP is generated by systematic structural variations with luminosity of the quantity $`K_\mathrm{V}`$), then we would expect only a parallel shift of the FP, i.e. only a systematic shift of its zero-point $`\gamma `$ with time. Clearly, this picture must be only approximately viable, because galaxies follow the metallicity - velocity dispersion relation (see Bender, Burstein, & Faber 1993 and references therein) and the color-magnitude relation (see Bower, Lucey, & Ellis 1992), consistent with the fact that the tilt of the FP depends on waveband (e.g., see the results based on near-infrared data obtained by Pahre, Djorgovski, & de Carvalho 1998). On the other hand, if, as is frequently done, we refer to the picture where all galaxies are strictly homologous systems, so that the tilt of the FP is completely due to a luminosity dependence of $`\mathrm{{\rm Y}}_{}`$ (at fixed metallicity), then the luminosity evolution of faint galaxies should be faster than that of bright galaxies, and the tilt of the FP would be expected to change with $`z`$, with the larger changes at the FP faint end. Here several different physical scenarios would be available (see also Renzini & Ciotti 1993).
* A study of the relation between weak homology and the popular paradigm of galaxy merging.

From the observational point of view, it is especially urgent to carry out a discussion of weak homology, extended to the spectroscopic (stellar-dynamical) data, for a complete sample of nearby early-type galaxies.

###### Acknowledgements.

We would like to thank T. van Albada, R. de Carvalho, M. Lombardi, and T. Treu for very useful comments and suggestions. This work has been partially supported by MURST of Italy (co-fin 2000).

## Appendix A Photometric Models

### A.1 $`R^{1/n}`$ and $`R^{1/4}`$ models

Consider the surface brightness profile (Sersic 1968) given by

$$I(R)=I_0e^{b\eta ^{1/n}},$$
(13)
where $`\eta =R/R_\mathrm{e}`$, $`n`$ is a positive real number, and $`b=b(n)`$ a dimensionless constant such that $`R_\mathrm{e}`$ is the effective radius, i.e., the projected radius encircling half of the total luminosity associated with $`I(R)`$. As proved in a separate paper (Ciotti & Bertin 1999), the first terms of the asymptotic expansion of $`b(n)`$, for large $`n`$, are $`b(n)2n1/3+4/(405n)`$, already accurate to a part in one thousand for $`n`$ as low as unity. The proper normalization of the R1/n profile, to be considered for a case with given scales $`L`$ and $`R_\mathrm{e}`$, is

$$I(R)=\frac{L}{R_\mathrm{e}^2}\frac{b^{2n}}{2\pi n\mathrm{\Gamma }(2n)}e^{b\eta ^{1/n}},$$
(14)
where $`\mathrm{\Gamma }`$ represents the complete Gamma function. The photometric profile is thus characterized by two scales (e.g., $`L`$ and $`R_\mathrm{e}`$) and one dimensionless parameter ($`n`$). The standard de Vaucouleurs (1948) profile is obtained by setting $`n=4`$.

### A.2 Two–component $`R^{1/4}`$+exponential models

For the surface brightness profile we take here the superposition of an $`R^{1/4}`$ component and a standard “exponential disk”, i.e.

$$I(R)=I_{1/4}(0)\mathrm{exp}[b(4)(R/R_{1/4})^{1/4}]+I_{\mathrm{exp}}(0)\mathrm{exp}[b(1)(R/R_{\mathrm{exp}})],$$
(15)
where $`R_{1/4}`$ and $`R_{\mathrm{exp}}`$ are the effective radii of the $`R^{1/4}`$ and of the exponential component, respectively. By fitting this model to an observed photometric profile, we can derive the total luminosities $`L_{\mathrm{exp}}`$, $`L_{1/4}`$ associated with the separate components and from these the total luminosity $`L_{\mathrm{tot}}=L_{1/4}+L_{\mathrm{exp}}`$. In conclusion, this two-component photometric model is characterized by two scales ($`L_{\mathrm{tot}}`$ and $`R_\mathrm{e}`$; for the latter quantity we refer to the effective radius for the combined profile) and by two dimensionless parameters (e.g., $`L_{\mathrm{exp}}/L_{\mathrm{tot}}`$ and $`R_{\mathrm{exp}}/R_{1/4}`$).

### A.3 $`f_{\mathrm{}}`$ models

The $`f_{\mathrm{}}`$ models are dynamical models applicable to collisionless stellar systems. They have been constructed (Bertin & Stiavelli 1984) by following the physical scenario that elliptical galaxies may have formed through collisionless collapse (van Albada 1982). In the spherical limit, their anisotropic distribution function is given by

$$f_{\mathrm{}}=\{\begin{array}{cc}A(E)^{3/2}\mathrm{exp}(aEcJ^2/2)\hfill & \text{if }E0\text{,}\hfill \\ 0\hfill & \text{if }E>0\text{,}\hfill \end{array}$$
(16)
where $`E=v^2/2+\mathrm{\Phi }(r)`$ and $`J`$ are the star energy and the magnitude of the star angular momentum, per unit mass, respectively. Two of the three available dimensional constants ($`A`$, $`a`$, and $`c`$) set the physical scales of the model (e.g., the total mass and the half–mass radius $`r_M`$). The remaining dimensionless parameter, for example written as $`\gamma =ac/(4\pi GA)`$, then characterizes the one–parameter family of $`f_{\mathrm{}}`$ models. The solution of the Poisson equation provides the relation $`\gamma =\gamma (\mathrm{\Psi })`$, where $`\mathrm{\Psi }`$ denotes the dimensionless central potential $`\mathrm{\Psi }=a\mathrm{\Phi }(0)`$. In practice, under the assumption that the stellar mass–to–light ratio is constant within the galaxy and after projection for comparison with the observations, the relevant photometric profile associated with the $`f_{\mathrm{}}`$ models, in addition to a luminosity scale ($`L`$) and a length scale ($`R_\mathrm{e}r_M/1.3`$), depends on one dimensionless parameter only ($`\mathrm{\Psi }`$). A detailed discussion of the properties of this equilibrium sequence is given by Bertin & Stiavelli (1993). Here we limit our discussion to $`f_{\mathrm{}}`$ models characterized by $`2\mathrm{\Psi }10`$. In fact, models with $`\mathrm{\Psi }<2`$ are unstable, while, on the other hand, models with $`\mathrm{\Psi }10`$ are very similar to each other on the large scale, except for the development of a nuclear concentration on scales much smaller than those studied in this paper.

Given the focus of the present paper on the $`R^{1/n}`$ photometric models, as a preliminary investigation we have compared the photometric profiles of the $`f_{\mathrm{}}`$ dynamical models (treated as “the galaxies” ) to those of the $`R^{1/n}`$ models (taken as the “fitted models”). We have thus obtained the best-fit $`n(\mathrm{\Psi })`$ by minimizing the quantity

$$\chi ^2=\underset{\eta _{\mathrm{min}}}{\overset{\eta _{\mathrm{max}}}{}}[\mu _{\mathrm{}}(\eta )\mu _{1/n}(\eta )]^2,$$
(17)
where $`\eta =R/R_\mathrm{e}`$ is expressed in units of the effective radius of the $`f_{\mathrm{}}`$ models. The adopted radial interval is $`0.1\eta 10`$; note that the adopted outer radius is well far out with respect to the radius $`R_{\mathrm{max}}`$ typically considered for observed photometric profiles.

We found that for $`f_{\mathrm{}}`$ models with $`\mathrm{\Psi }\begin{array}{c}>\hfill \\ \hfill \end{array}5`$ a fit over the adopted radial interval can be obtained with $`(\mathrm{\Delta }\mu )_{\mathrm{max}}<0.4`$. In contrast, for $`\mathrm{\Psi }\begin{array}{c}<\hfill \\ \hfill \end{array}5`$, in order to obtain a fit with $`(\mathrm{\Delta }\mu )_{\mathrm{max}}<0.4`$ we had to reduce the radial interval to typical values $`0.23\eta 4`$. This smaller radial range is actually applicable to realistic conditions. In these latter cases of low-$`\mathrm{\Psi }`$ models we found that the best-fit value of $`n`$ is sensitive to the specific radial interval adopted; for example, the quality condition $`(\mathrm{\Delta }\mu )_{\mathrm{max}}<0.4`$ can be satisfied for a different radial range (say $`0.1\eta 2`$), but the resulting best-fit value of $`n`$ turns out to be significantly lower. In Fig. A.1 we show the optimal fitting relation $`n=n(\mathrm{\Psi })`$ for the fits based on the full radial range, for $`\mathrm{\Psi }5.5`$, and on the reduced radial range ($`0.23\eta 4`$) for $`\mathrm{\Psi }<5.5`$. Note how close to the de Vaucouleurs profiles, $`n=4`$, are the high-$`\mathrm{\Psi }`$ models, as realized from the very beginning (see Bertin & Stiavelli 1993).

## Appendix B Fitting procedures

In this Appendix we briefly describe different options to fit a model, chosen within the set of models presented in Appendix A, to the photometry of observed objects available within a given spatial range.

### B.1 Profiles, circularized profiles, curves of growth

In the procedure of profile fitting, we generally refer to circularized profiles. The objects selected for the present study are fairly round in projection. Therefore, the differences between the photometric profiles taken along the short (with coordinate $`R_s`$) or the long (with coordinate $`R_l`$) axis (as preferred by CCD93, DCC94) with respect to the profiles obtained by referring to the circularized radius $`R=\sqrt{R_sR_l}`$ are rather small.

The observed profiles in $`\mathrm{mag}/\mathrm{arc}\mathrm{sec}^2`$, $`\mu _{\mathrm{obs}}(R)=2.5\mathrm{log}I_{\mathrm{obs}}(R)`$, are compared to the corresponding model profiles $`I_{\mathrm{mod}}`$

$$\mu _{\mathrm{mod}}(R)=2.5\mathrm{log}I_{\mathrm{mod}}(R).$$
(18)
Following standard methods (e.g., see Bertin, Saglia, & Stiavelli 1988), the best-fit parameters are determined by minimizing the $`\chi ^2`$ function defined as:

$$\chi ^2=\underset{i=1}{\overset{N}{}}\frac{[\mu _{\mathrm{obs}}(R_i)\mu _{\mathrm{mod}}(R_i)]^2}{\sigma _{\mathrm{obs}}^2(R_i)(NN_{\mathrm{par}})},$$
(19)
where $`N`$ is the number of data-points in the interval $`(R_{\mathrm{min}},R_{\mathrm{max}})`$, $`\sigma _{\mathrm{obs}}(R_i)`$ represents the photometric error on $`\mu _{\mathrm{obs}}(R_i)`$, and the factor $`(NN_{\mathrm{par}})`$ takes into account the number of free parameters in the fit. The formal errors $`\delta _i`$ associated with the best-fit values of the parameters $`x_i`$ involved can be calculated from the covariance matrix $`𝐄=2𝐇^\mathrm{𝟏}`$, where $`𝐇`$ is defined as

$$H_{ij}=(NN_{\mathrm{par}})\frac{^2\chi ^2}{x_ix_j}.$$
(20)
Therefore, we have

$$\delta _i=\sqrt{E_{ii}},$$
(21)
while the off-diagonal terms provide the correlation coefficients.

The parameters thus determined (e.g., the effective radius $`R_\mathrm{e}`$) do not represent the quantities implied by their ideal definitions (e.g., the projected radius of the disk that encloses half of the total luminosity), because the fit is performed only on a limited radial range ($`R_{\mathrm{min}}`$, $`R_{\mathrm{max}}`$). In this procedure the model parameters (e.g., $`n`$, $`R_\mathrm{e}`$, and $`I_0`$ for the $`R^{1/n}`$ models) are taken to be independent of each other.

A second fitting procedure (preferred, e.g., by PS97) refers to the so-called curve of growth, i.e. to the function associated with the integrated luminosity $`L(R)=2\pi _0^RR^{}I(R^{})𝑑R^{}`$. One then compares the data points for $`m_{\mathrm{obs}}(R)=2.5\mathrm{log}L_{\mathrm{obs}}(R)`$, expressed in magnitudes, to the corresponding curve of growth $`m_{\mathrm{mod}}(R)`$ derived from the photometric model. It is clear that this procedure involves a major difference with respect to the profile fitting procedure, because the data points of the curves of growth cannot be treated as independent of each other. If we proceed naively, but improperly, by means of a $`\chi ^2`$ function defined as in Eq. (B.2), (but in the results shown in Section 2.3 we took a constant photometric error) with $`\mu `$ replaced by $`m`$, we find “best-fit values” of the relevant parameters that can be significantly discrepant with respect to those found from profile fitting (compare the values of $`n`$ given in the second column of Table 3 with those recorded in Table 1). The discrepancies follow the general trends reported in the literature (see Introduction and PS97).

### B.2 Constraints

One of the tests that we have performed on our set of observed photometries has been the study of the dependence of the best-fit parameters on the radial range of the fit. In order to compare with earlier studies (e.g., see Burkert 1993), we have thus considered a case where all photometric profiles for the four galaxies studied in this paper were limited to a common excursion of 4.5 mag (see second group of columns in Table 3).

Another natural possibility (see Bertin, Saglia, & Stiavelli 1988) is to consider a fit under the constraint that the observed profile and the model profile be characterized by the same integrated luminosity within the radial range of the fit. To these fits we refer as fits with constrained luminosity (see Sect. 2, third group of columns in Table 3). Explicitly, we impose:

$$_{R_{\mathrm{min}}}^{R_{\mathrm{max}}}RI_{\mathrm{obs}}(R)𝑑R=_{R_{\mathrm{min}}}^{R_{\mathrm{max}}}RI_{\mathrm{mod}}(R)𝑑R,$$
(22)
so that the luminosity scale is set as a constraint and the number of free parameters with respect to which the $`\chi ^2`$ function is minimized is reduced by one.

Similarly, for the fit to the curves of growth it is natural to impose that $`L_{\mathrm{obs}}(R_{\mathrm{max}})=L_{\mathrm{mod}}(R_{\mathrm{max}})`$.

### B.3 Comments

Not unexpectedly, when free parameters are available, such as $`n`$ or $`\mathrm{\Psi }`$, the search for the best-fit model actually leads to several possible minima of the relevant $`\chi ^2`$ function. In Table 2 we have recorded the properties (in parentheses) of a secondary minimum available for NGC 1379, within the $`f_{\mathrm{}}`$ models, which appears to be particularly significant. In Tables 1 and 3 we have considered only the $`R^{1/n}`$ models corresponding to the absolute minima found. For each galaxy, we have also checked the properties of other (typically 4 or 5) models corresponding to secondary minima, with $`\chi ^2`$ within a factor of 3-4 with respect to that associated with the absolute minimum. The related model parameters turn out to be significantly different only when the associated value of $`\chi ^2`$ changes significantly. The values of $`n`$ and $`R_\mathrm{e}`$ thus identified tend to increase, or decrease, together, but the photometric parameter $`\varphi _{\mathrm{FP}}`$ remains robustly stable.

The case illustrated briefly in the second group of columns in Table 3, that of the reduced radial range, presents, not surprisingly, the most complex behavior. Here we can even witness the occurrence of “crossing” of solutions. An example of this phenomenon is provided by the galaxy NGC 4374. For this object the absolute minimum over the reduced radial range is obtained for $`n14.5`$ and $`R_\mathrm{e}1092`$, with $`\chi ^20.34`$ (see Table 3). A very near (when considering the $`\chi ^2`$ value) secondary minimum is $`n9.9`$ and $`R_\mathrm{e}302`$, with $`\chi ^20.55`$. When fitting the profile of the same galaxy over the extended radial range the absolute minimum is found (see Table 1) at $`n9.5`$ with $`R_\mathrm{e}259`$ and $`\chi ^20.46`$. Thus, the solution corresponding to the absolute minimum obtained over the the whole available radial range can turn out to be associated with a secondary minimum when the fit is extended over a reduced radial range.

## Appendix C General properties of the velocity dispersion profiles of simple dynamical models

If we wish to draw consequences, from the observed trends in the photometric profiles, on the structure of the FP, we have to take into account some dynamical information. In practice, for the objects under consideration we have to estimate the relevant virial coefficient (see Appendix D). Since the dynamical quantity that appears in the FP is the central (projected) velocity dispersion (based on a suitable small aperture), it is clear that our consequences will depend mostly on the assumed behavior, for the velocity dispersion profiles, in the vicinity of the galactic center. In this Appendix we will show that if we start from a given density profile and then proceed to infer, as commonly done (through the Jeans equations under simple assumptions on the pressure tensor; e.g., see PS97), the velocity dispersion profile, the resulting kinematical profile is very sensitive to the specific limiting behavior (at very small radii) of the density profile we consider. In many cases the implied kinematical profile may be completely unrealistic (e.g., by developing a major “central hole”, not observed; see Bailey & MacDonald 1981). This sensitivity is unfortunate, because it makes it necessary to address in detail the dynamical basis of the photometric models used to fit the observations. In this respect, we should recall here that the velocity dispersion profiles of the $`f_{\mathrm{}}`$ models (see Appendix A.3) are (generally realistic) monotonic, decreasing with radius.

In the following we focus on spherically symmetric, isotropic, one–component galaxy models with finite mass and, for simplicity, limit our discussion to the unprojected velocity dispersion only.

Suppose that the model density profile at small radii is characterized by the asymptotic behavior

$$\rho (r)r^\alpha ,$$
(23)
with $`0\alpha <3`$. From the explicit solution of the appropriate hydrostatic equilibrium condition,

$$\frac{d}{dr}[\rho (r)\sigma _\mathrm{r}^2(r)]=G\frac{\rho (r)M(r)}{r^2},$$
(24)
it is readily shown that for $`\alpha =0`$ the velocity dispersion reaches a finite (non–vanishing) value at the center (dependent on the shape of the entire density profile). For $`0<\alpha <1`$ we find

$$\sigma _\mathrm{r}^2(r)r^\alpha ,$$
(25)
and so $`\sigma _\mathrm{r}^2(0)=0`$ and a “central hole” is present (note that all $`R^{1/n}`$ models fall in this case, because close to the center their density profile is characterized by $`\alpha =11/n`$). When $`\alpha =1`$, we have

$$\sigma _\mathrm{r}^2(r)r\mathrm{ln}(r),$$
(26)
and so the central value of the velocity dispersion vanishes. Finally, for $`1<\alpha <3`$ the relation is

$$\sigma _\mathrm{r}^2(r)r^{2\alpha }.$$
(27)
Thus, for $`1<\alpha <2`$ the central velocity dispersion vanishes and a hole occurs; when $`\alpha =2`$ the central velocity dispersion is finite (its value depends on the shape of the entire density profile, as in the case $`\alpha =0`$), and for $`2<\alpha <3`$ it diverges.

In order to obtain an estimate of the velocity dispersion gradient close to the center, we can rewrite Eq. (C2) as

$$\frac{d\sigma _\mathrm{r}^2}{dr}=G\frac{M(r)}{r^2}G\frac{1}{\rho ^2}\frac{d\rho }{dr}_r^{\mathrm{}}\frac{\rho (x)M(x)}{x^2}𝑑x.$$
(28)
Let us now focus on the case $`\alpha =0`$, and thus express the density profile as $`\rho (r)\rho (0)\rho _1r^\beta `$. Then, it can be shown that for $`0<\beta <2`$ there is indeed a hole in the velocity dispersion; in turn, for $`\beta =2`$ the direction of the slope of the velocity dispersion depends on the density profile of the entire model, while for $`\beta >2`$ the velocity dispersion is monotonically decreasing with radius.

We may add that, independently of the slope of the stellar density profile in the central regions, if a massive black hole is present, then the slope of the square of the velocity dispersion is -1, and so, at least in the central regions, no hole is present in the velocity dispersion profile.

By experimenting with more general density profiles in the central regions, we have also encountered the possibility of “wavy” velocity dispersion profiles.

## Appendix D The virial coefficient $`K_\mathrm{V}`$

After this short kinematical digression, it should be clear that the virial coefficient $`K_\mathrm{V}=GM/(R_\mathrm{e}\sigma _0^2)`$ that controls the relation between the virial theorem and the FP is sensitive to the dynamical model that we adopt to describe galaxies, not just to the photometric signature as captured, for example, by the $`R^{1/n}`$ profiles. In addition, within a given set of dynamical models, the virial coefficient can be sensitive to the precise definition that we adopt for “central velocity dispersion”.

To set the basis for our simulations of Sect. 3, we have computed the virial coefficient for the isotropic $`R^{1/n}`$ models, with $`\sigma _0`$ based on an aperture of radius $`R_\mathrm{e}/10`$. In addition, to illustrate the above-mentioned sensitivity problem we have computed the same coefficient also for the $`f_{\mathrm{}}`$ models. We have checked that, for the isotropic $`R^{1/n}`$ models, the numbers are in agreement with those reported earlier by PS97. The results are summarized in Fig. D.1.

From this figure, an immediate warning in relation to the sensitivity problem derives from inspection of the high-$`\mathrm{\Psi }`$ models: while with respect to the photometric performance the models with $`7\mathrm{\Psi }10`$ are all very well fitted by $`R^{1/4}`$ profiles (see Fig. A.1), their virial coefficient is found to vary significantly, from $`2.3`$ to $`3.3`$.

Another simple way to point out quantitatively the embarassing modeling problem that we are facing is given in Table D.1. Here we record, for the four galaxies studied in this paper, the value of the virial coefficient obtained by referring to the best-fit $`R^{1/n}`$ models suggested by Table 1, to those of Table 3 (b: reduced radial range), or to the best-fit $`f_{\mathrm{}}`$ models identified in Table 2. Note that if we modeled these galaxies as isotropic $`R^{1/4}`$ models, they would all be assigned the same virial coefficient $`K_{1/4}4.6`$. We should emphasize that, in the spirit of the studies of the FP, all these inferences are made without considering the detailed behavior of the actual velocity dispersion profiles for the galaxies under investigation.


text:
# Spectral Function of 𝜌 in Dense and Hot Hadronic Matter

## Abstract:

The spectral function of rho meson in hot/dense hadronic matter is studied by taking into account the nucleon-loop on quantum hadrondynamics model level. Different from the hot pion gas effect which changes the spectral function slightly, the nucleon-antinucleon polarization (Dirac sea) makes the spectral function very sharp and shifted towards the low invariant mass region significantly due to the decreasing effective nucleon mass.

Spectral function, vector meson, QHD, finite temperature field theory  preprint: .

It is widely prospected that in ultra-relativistic heavy-ion collisions a new phase of matter—quark-gluon plasma (QGP) may be generated and the spontaneously broken chiral symmetry may be restored. Among the proposed various signals which can detect the phase transitions in strongly interacting matter, the electromagnetic signals-dileptons and photons are considered to be the clearest ones, since they can penetrate the medium almost undisturbed. Considering the fact that light vector mesons can directly decay to dilepton pairs, the study about $`\rho `$ meson in medium is especially interesting because the lifetime of $`\rho `$ is smaller than that of the fireball formed in heavy-ion collisions and the decay of $`\rho `$ can be completed inside it. The strong enhancement of low mass dileptons in central $`AA`$ collisions observed by CERES-NA45 has excited many theoretical works. Among them, the mass dropping of $`\rho `$ mesons provides a good description of the data.

The mass spectrum of hadrons in extreme hadronic environment has been widely discussed. One of the familiar results is the Brown-Rho scaling law indicating that the masses of nucleons and mesons decrease in hot/dense hadronic environment. For light vector mesons, it is difficult to extract an unique conclusion from different model calculations. The mean field theory (MFT) and effective Lagrangians can give similar results as the Brown-Rho scaling , but the results from some QCD sum rules may be different from it and even contrast to it. The property of $`\rho `$ in hot/dense environment is not yet clear and needs further study.

The hot topic in recent years is discussing the low invariant mass dilepton production in heavy ion collisions. The dilepton distribution is related with the spectral function of $`\rho `$ meson, i.e., the imaginary part of the retarded propagator of $`\rho `$ in medium , which reflects the comprehensive medium effects. From the point of view of the partial chiral symmetry restoration the $`\rho `$ spectral function has been widely discussed in recent literature such as in Refs. (and references therein).

The key point of discussing the $`\rho `$ spectral function is how to calculate the $`\rho `$ meson self-energy in nuclear environment. In this paper, the effects of the decreasing effective nucleon mass on the $`\rho `$ spectral function in medium are discussed. With quantum hadrodynamics model(QHD) of nuclear matter, the effective nucleon mass drops down with density/temperature and should be taken into account in discussing the effective mass as well as the decay width of $`\rho `$ in medium, i.e., the spectral function. H. Shiomi and T. Hatsuda have found that the effective $`\rho `$ meson mass decreases in nuclear matter due to the nucleon polarization at finite density with QHD-I type effective Lagrangian. By extending their work to finite temperature, the temperature and density dependence of the $`\rho `$-meson spectral function due to nucleon loop is discussed.

In Minkowski space, the self-energy of the light vector meson $`\rho `$ can be expressed as

$`\mathrm{\Pi }^{\mu \nu }=\mathrm{\Pi }_LP_L^{\mu \nu }+\mathrm{\Pi }_TP_T^{\mu \nu },`$ (1)
where $`k^2=k_0^2𝐤^2`$. The $`P_L^{\mu \nu }(k)`$ and $`P_T^{\mu \nu }(k)`$ are the standard longitudinal and transverse projection tensors

$`P_T^{00}`$ $`=P_T^{0i}=P_T^{i0}=0,P_T^{ij}=\delta ^{ij}{\displaystyle \frac{k^ik^j}{𝐤^2}},`$
$`P_L^{\mu \nu }`$ $`={\displaystyle \frac{k^\mu k^\nu }{k^2}}g^{\mu \nu }P_T^{\mu \nu }.`$ (2)
The longitudinal and transverse elements of the self-energy can be determined by

$`\mathrm{\Pi }_L(k)={\displaystyle \frac{k^2}{𝐤^2}}\mathrm{\Pi }^{00}(k),\mathrm{\Pi }_T(k)={\displaystyle \frac{1}{2}}P_T^{ij}\mathrm{\Pi }_{ij}(k).`$ (3)
Noting that the self-energy is related to the full ($`𝒟`$) and bare ($`𝒟_0`$) propagators by

$`\mathrm{\Pi }^{\mu \nu }=(𝒟^1)^{\mu \nu }(𝒟_0^1)^{\mu \nu },`$ (4)
one can obtain

$`𝒟^{\mu \nu }={\displaystyle \frac{P_L^{\mu \nu }}{k^2m_\rho ^2\mathrm{\Pi }_L}}{\displaystyle \frac{P_T^{\mu \nu }}{k^2m_\rho ^2\mathrm{\Pi }_T}}{\displaystyle \frac{k^\mu k^\nu }{m_\rho ^2k^2}},`$ (5)
where $`m_\rho `$ is the free mass of $`\rho `$ in vacuum.

The property of in-medium $`\rho `$ is determined by its full propagator. The imaginary part of the retarded propagator is referred to as the spectral function and related to the dilepton production with vector meson dominance model. The study of the $`\rho `$ spectral function is attributed to calculating the in-medium self-energy. By concentrating on decreasing nucleon mass effects, the in-medium $`\rho `$ property is analysed in terms of the Feynman diagrams displayed in Fig.1.

The pion effect has been analyzed in Ref., and in Minkowski space the pion-loop contribution to $`\rho `$ self-energy can be written as

$$\mathrm{\Pi }_{\mu \nu }^{\rho \pi \pi }(k)=g_\rho ^2T\underset{p_0}{}\frac{d^3p}{(2\pi )^3}\frac{(2p+k)_\mu (2p+k)_\nu }{(p^2m_\pi ^2)[(p+k)^2m_\pi ^2]}+2g_{\mu \nu }g_\rho ^2T\underset{p_0}{}\frac{d^3p}{(2\pi )^3}\frac{1}{p^2m_\pi ^2},$$
(6)
where the 0-component of $`\pi `$ loop momentum is related to temperature via $`p_0=2n\pi Ti`$, with $`n=0,\pm 1,\pm 2,\mathrm{}`$.

The contribution of nucleon excitations through nucleon-loop to $`\rho `$ self-energy is analyzed in terms of the effective Lagrangian

$`_{\rho NN}=g_{\rho NN}(\overline{\mathrm{\Psi }}\gamma _\mu \tau ^a\mathrm{\Psi }V_a^\mu {\displaystyle \frac{\kappa _\rho }{2M_N}}\overline{\mathrm{\Psi }}\sigma _{\mu \nu }\tau ^a\mathrm{\Psi }^\nu V_a^\mu ),`$ (7)
where $`V_a^\mu `$ is the $`\rho `$ meson field and $`\mathrm{\Psi }`$ the nucleon field. It can be written as

$`\mathrm{\Pi }_{\mu \nu }^{\rho NN}(k)=2g_{\rho NN}^2T{\displaystyle \underset{p_0}{}}{\displaystyle \frac{d^3p}{(2\pi )^3}\mathrm{Tr}\left[\mathrm{\Gamma }_\mu (k)\frac{1}{p/M_N^{}}\mathrm{\Gamma }_\nu (k)\frac{1}{(p/k/)M_N^{}}\right]},`$ (8)
where $`\mathrm{\Gamma }_\mu `$ is defined as $`\mathrm{\Gamma }_\mu (k)=\gamma _\mu +\frac{i\kappa _\rho }{2M_N}\sigma _{\mu \nu }k^\nu `$ with $`\sigma _{\mu \nu }=\frac{i[\gamma _\mu ,\gamma _\nu ]}{2}`$, $`M_N`$ and $`M_N^{}`$ are the nucleon masses in vacuum and medium, respectively. The 0-component of nucleon loop momentum is related to temperature via $`p_0=(2n+1)\pi Ti+\mu ^{}`$ with $`\mu ^{}`$ being the effective chemical potential of nucleon.

With residue theorem the $`\rho NN`$ contribution can be separated into two parts

$`\mathrm{\Pi }_{\mu \nu }^{\rho NN}(k)=({\displaystyle \frac{k_\mu k_\nu }{k^2}}g_{\mu \nu })\mathrm{\Pi }_F^{\rho NN}(k)+\mathrm{\Pi }_{D,\mu \nu }^{\rho NN}(k).`$ (9)
The first part $`\mathrm{\Pi }_F^{\rho NN}(k)`$ corresponding to $`\mathrm{\Pi }^F`$ of Ref.  contains divergent integrals and needs to be regularized. However, it can not be renormalized by the conventional method. Using the dimensional regularization method and taking a phenomenological procedure

$`^n\mathrm{\Pi }_F^{\rho NN}(k)/(k^2)^n|_{M_N^{}M_N,k^2=m_\rho ^2}=0,(n=0,1,2,\mathrm{},\mathrm{})`$ (10)
one can eliminate the real vacuum ($`T=0`$) part and obtain the finite result

$`\mathrm{\Pi }_{F,L(T)}^{\rho NN}(k)=`$ $`k^2{\displaystyle \frac{g_{\rho NN}^2}{\pi ^2}}\left(P_1+{\displaystyle \frac{\kappa _\rho M_N^{}}{2M_N}}P_2+({\displaystyle \frac{\kappa _\rho }{2M_N}})^2{\displaystyle \frac{k^2P_1+M_{N}^{}{}_{}{}^{2}P_2}{2}}\right),`$ (11)
$`P_1=`$ $`{\displaystyle _0^1}𝑑xx(1x)\mathrm{ln}c,P_2={\displaystyle _0^1}𝑑x\mathrm{ln}c,`$
$`c=`$ $`{\displaystyle \frac{M_{N}^{}{}_{}{}^{2}x(1x)k^2}{M_{N}^{}{}_{}{}^{2}x(1x)k^2}}.`$
It is easy to see that the medium effect on $`\mathrm{\Pi }_F^{\rho NN}`$ is also introduced by the effective nucleon mass $`M_N^{}`$ in hadronic environment which will be determined by QHD-I below.

The second part $`\mathrm{\Pi }_{D,\mu \nu }^{\rho NN}(k)`$ in (9) is explicitly related to distribution function $`n_N(T,\mu ^{})`$(corresponding to the Fermi sea contribution at $`T=0`$). Its calculation is lengthy. We list here only the longitudinal results

$`\mathrm{\Pi }_{D,L}^{\rho NN}(k)=`$ $`\mathrm{\Pi }_{1D,L}^{\rho NN}(k)+\mathrm{\Pi }_{2D,L}^{\rho NN}(k)+\mathrm{\Pi }_{3D,L}^{\rho NN}(k),`$ (12)
$`\mathrm{\Pi }_{1D,L}^{\rho NN}(k)=`$ $`{\displaystyle \frac{g_{\rho NN}^2k^2}{\pi ^2𝐤^2}}{\displaystyle }{\displaystyle \frac{p^2dp}{\omega }}(n_N+\overline{n}_N)[2`$
$`+{\displaystyle \frac{k^24\omega k_0+4\omega ^2}{4p|𝐤|}}\mathrm{ln}a+{\displaystyle \frac{k^2+4k_0\omega +4\omega ^2}{4p|𝐤|}}\mathrm{ln}b],`$
$`\mathrm{\Pi }_{2D,L}^{\rho NN}(k)=`$ $`{\displaystyle \frac{g_{\rho NN}^2k^2}{\pi ^2|𝐤|}}{\displaystyle \frac{\kappa _\rho }{2M_N}}M_N^{}{\displaystyle \frac{pdp}{\omega }(n_N+\overline{n}_N)\left[\mathrm{ln}a+\mathrm{ln}b\right]},`$
$`\mathrm{\Pi }_{3D,L}^{\rho NN}(k)=`$ $`{\displaystyle \frac{g_{\rho NN}^2k^2}{\pi ^2𝐤^2}}({\displaystyle \frac{\kappa _\rho }{2M_N}})^2{\displaystyle }{\displaystyle \frac{p^2dp}{\omega }}(n_N+\overline{n}_N)[2k_0^2`$
$`+{\displaystyle \frac{𝐤^2(k^24p^2)+(k^22\omega k_0)^2}{4p|𝐤|}}\mathrm{ln}a+{\displaystyle \frac{𝐤^2(k^24p^2)+(k^2+2\omega k_0)^2}{4p|𝐤|}}\mathrm{ln}b],`$
where $`a`$, $`b`$, $`\omega `$, $`n_N`$, $`\overline{n}_N`$ are defined by

$`a`$ $`={\displaystyle \frac{k^22p|𝐤|2k_0\omega }{k^2+2p|𝐤|2k_0\omega }},b={\displaystyle \frac{k^22p|𝐤|+2k_0\omega }{k^2+2p|𝐤|+2k_0\omega }},`$ (13)
$`\omega `$ $`=\sqrt{p^2+M_{N}^{}{}_{}{}^{2}},n_N={\displaystyle \frac{1}{e^{\beta (\omega \mu ^{})}+1}},\overline{n}_N={\displaystyle \frac{1}{e^{\beta (\omega +\mu ^{})}+1}}.`$
Before making further discussions, it should be emphasized that the inclusion of the pion tadpole diagram is very crucial for the current conservation condition(gauge invariance). It is interesting that the self-energy is divided into two parts such as in (9) with residue theorem and the two parts separately satisfy the current conservation. The current conservation condition ensures the transversality of $`\mathrm{\Pi }^{\mu \nu }`$, which is reflected in the properties of the projection tensors $`P_L^{\mu \nu }`$ and $`P_T^{\mu \nu }`$ such as $`k_\mu P_{L(T)}^{\mu \nu }=0`$.

After analytical continuation according to $`k_0E+i\epsilon `$, $`E=\sqrt{M_\rho ^2+𝐤^2}`$ with $`M_\rho `$ being the $`\rho `$ invariant mass in medium, one can obtain the real and imaginary parts of the self-energy. Then by using the definition of $`\rho `$ meson spectral function

$`𝒜_{L(T)}(k)=2{\displaystyle \frac{Im\mathrm{\Pi }_{L(T)}(k)}{\left[M_\rho ^2(m_\rho ^2+Re\mathrm{\Pi }_{L(T)}^\rho (k))\right]^2+\left[Im\mathrm{\Pi }_{L(T)}^\rho (k)\right]^2}},`$ (14)
where $`\mathrm{\Pi }_{L(T)}`$ is the total longitudinal or transverse self-energy, one can analyze the medium effects on $`\rho `$ meson.

The effective mass $`M_N^{}`$ and effective chemical potential $`\mu ^{}`$ of the nucleon in $`\mathrm{\Pi }^{\rho NN}`$ are determined from the simplest QHD-I at mean field level. The QHD-I is a renormalizable model including nucleon and meson degrees of freedom

$`=`$ $`\overline{\psi }\left[\gamma _\mu (i^\mu g_vV^\mu )(M_Ng_s\varphi )\right]\psi +{\displaystyle \frac{1}{2}}(_\mu ^\mu \varphi m_s^2\varphi ^2)`$ (15)
$`{\displaystyle \frac{1}{4}}F_{\mu \nu }F^{\mu \nu }+{\displaystyle \frac{1}{2}}m_v^2V_\mu V^\mu +\delta ,`$
where $`\psi `$ is the nucleon field, $`\varphi `$ the neutral scalar field with free mass $`m_s`$, $`F_{\mu \nu }=_\mu V_\nu _\nu V_\mu `$ the field tensor of $`\omega `$ meson with free mass $`m_v`$, and $`\delta `$ the renormalization counterterm.

In mean field approximation, the meson field operators are replaced by the ground-state expectation values

$`\varphi `$ $`<\varphi >=\varphi _0,V^\mu <V^\mu >=g^{\mu 0}V^0.`$ (16)
With MFT by neglecting the vacuum fluctuation contribution, the classical field $`\varphi _0`$ is a dynamical quantity which makes the nucleon mass drop and can be determined self-consistently by

$`M_NM_N^{}=g_s\varphi _0=g_s^2<\overline{\psi }\psi >={\displaystyle \frac{g_s^2}{m_s^2}}\rho _s,`$ (17)
where the scalar baryon density $`\rho _s`$ is defined as

$`\rho _s={\displaystyle \frac{\gamma }{(2\pi )^3}}{\displaystyle d^3𝐤\frac{M_N^{}}{\omega }\left[n_N(\mu ^{},T)+\overline{n}_N(\mu ^{},T)\right]},`$ (18)
with the nucleon degenerate factor $`\gamma =4`$.

The effective chemical potential $`\mu ^{}`$ is introduced by

$`\mu ^{}=\mu g_v^2\rho _N/m_v^2,`$ (19)
with the baryon density

$`\rho _N={\displaystyle \frac{\gamma }{(2\pi )^3}}{\displaystyle d^3𝐤\frac{M_N^{}}{\omega }[n_N(\mu ^{},T)\overline{n}_N(\mu ^{},T)]}.`$ (20)
One can solve the coupled equations (17) and (19) numerically. With the parameters $`g_s^2=109.626`$, $`g_v^2=190.431`$, $`m_s=520MeV`$, $`M_N=938MeV`$, and $`m_v=783MeV`$ according to the bulk binding energy and normal density of nuclear matter at saturation, the effective nucleon mass and chemical potential with MFT are displayed in Fig.2.

The longitudinal spectral functions (14) in medium are drawn in Figs.3 and 4 for different hadronic environment. The parameters are chosen to be $`m_\pi =139.6MeV`$, $`m_\rho =770MeV`$, $`g_\rho ^2=4\pi 2.91`$, $`g_{\rho NN}^2=6.91`$, $`\kappa _\rho =6.1`$. It should be noted that, different from $`\omega `$, the tensor coupling is very important for the interaction of $`\rho `$ with nucleons. Here we use the coupling constants $`g_{\rho NN}`$ and $`\kappa _\rho `$ determined from the fitting of the nucleon-nucleon interaction data done by the Bonn group. As shown in Fig.3, when nucleon-loop is not taken into account, there is only temperature effect and the $`\rho `$ meson spectral function changes weakly. With the increase of temperature, the spectral function becomes a little bit wider and is shifted towards the high invariant mass region slightly. This behavior agrees with the result of Ref..

The spectral function including the nucleon-loop contribution is shown in Fig.4. The solid lines are still the calculation in vacuum, but the dashed and dot-dashed lines contain the density and finite temperature effects. The dotted line represents the result of pure density effect ($`T=0`$, $`\rho _B0`$). The density effect on $`\rho `$ spectral function is obviously important by comparing Fig.3 with Fig.4. The nucleon excitation shifts the spectral function towards low invariant mass region. As indicated in the left panel of Fig.4, in the case of low density, $`\rho _N/\rho _0=0.1`$, the density effect is already remarkable compared with the pure temperature effect shown in Fig.3. The peak position of spectral function is shifted from $`0.77GeV`$ in vacuum to about $`0.63GeV`$ in medium.

The second characteristic of nucleon loop effect is the sharping of $`\rho `$ spectral function. Even for low density situation, see the left panel of Fig.4 with $`\rho _N/\rho _0=0.1`$, the $`\rho `$ meson width is already reduced to about half of that in vacuum. When density is high enough, see the right panel of Fig.4 with $`\rho _N/\rho _0=1.5`$, the spectral function approaches to a $`\delta `$-like function. This is mainly a consequence of the reduced two-pion phase space due to the $`\rho `$ mass decrease in medium.

Another significance of the nucleon loop is its approximate saturation at high density. At $`\rho _N/\rho _0=1.5`$, the two lines with temperature $`T=0.1GeV`$ and $`0.15GeV`$ almost coincide with each other. When density goes up further, for instance taking $`\rho _N/\rho _0=2`$, the spectral function is almost the same as the corresponding line in the right panel of Fig.4 for $`\rho _N/\rho _0=1.5`$. This saturation tendency can be seen from the effective mass $`m_\rho ^{}`$ determined by the pole position of its propagator in medium

$`k_0^2m_\rho ^2\underset{|𝐤|0}{lim}\mathrm{\Pi }^{L(T)}(k)=0,`$ (21)
as indicated by Fig.5. For comparison, we also give the effective nucleon mass $`M_N^{}`$. By taking MFT, $`m_\rho ^{}`$ and $`M_N^{}`$ are displayed in the left panel of Fig. 5. When density is higher than $`\rho _0`$, $`m_\rho ^{}`$ approaches its minimum value and then increases with the increase of density a little bit. The result of $`m_\rho ^{}`$ with the nucleon propagator obtained with the relativistic Hartree approximation (RHA) by including vacuum fluctuation contribution instead of MFT is quite similar except the numerical difference, as indicated in the right panel of Fig.5. Vector meson masses will decrease with the increase of density for a model including the polarization of nucleon-antinucleon with a decreasing effective nucleon mass. The numerical calculation indicates that the Dirac sea contribution dominates.

It should be noted that the interactions between mesons and nucleons are point-like in QHD. Considering the fact that mesons and nucleon are composite, a phenomenological monopole form factor is multiplied at each meson-N vertex

$`F_\alpha (k^2)={\displaystyle \frac{\mathrm{\Lambda }_\alpha ^2m_\alpha ^2}{\mathrm{\Lambda }_\alpha ^2k_\mu ^2}},`$ (22)
where $`k_\mu `$ is the four-momentum transfer, $`m_\alpha `$ the mass of the exchanged meson and $`\mathrm{\Lambda }_\alpha `$ the relevant cut-off mass. For $`\rho NN`$ vertex, $`\mathrm{\Lambda }_\rho `$ is usually taken as $`\mathrm{\Lambda }_\rho =1.5GeV`$.

The inclusion of form factor attenuates the behavior of effective mass $`m_\rho ^{}`$ significantly, which makes the magnitude of mass shift in medium smaller than that without the form factor. For analyzing the influence of form factor on the effective mass $`m_\rho ^{}`$, the two situations with/without form factor contribution have been drawn out in Fig.5. The displayed spectral function in Fig. 4 has included the form factor contribution.

Our result of the spectral function is different from previous results such as in Refs.. From Figs.4 and 5, one can see that effects of the decreasing effective nucleon mass on $`\rho `$ spectral function are important but they are not considered in Refs.. On the other hand, by focusing on the effects of decreasing nucleon mass on QHD-I level, any other decay channels which can contribute to the imaginary as well as the real parts of the self-energy are not included in our calculation and also cause the difference.

In summary, we discussed the density and temperature effects on $`\rho `$ meson spectral function with the effective Lagrangian. Different from the pure temperature effect of the pion loop which changes $`\rho `$ meson mass only a little and shifts the spectral function towards high invariant mass region slightly, the nucleon-loop changes the $`\rho `$ meson properties differently and significantly: 1) The spectral function is shifted towards low mass region remarkably even in the case of low density; 2) Together with the shift towards low mass region, the spectral function becomes very sharp due to Dirac sea polarization with the decreasing nucleon mass in medium; The density effect on the spectral function approaches to saturation when the density increases. 3) The influence of a phenomenological vertex form factor may prevent the effective $`\rho `$ mass decreasing to some extent within hadronic level. Although the behavior of $`m_\rho ^{}`$ in low density region is expected to be not so stiff, our result indicates that the effects of decreasing nucleon mass may be remarkable and should be taken into account in discussing the in-medium $`\rho `$ property. The relation between our result and those from QCD sum rules esp. in the low density region is not yet well understood and needs to be clarified further.

###### Acknowledgments.

The work was supported in part by the NSFC and the 973 Project.