Human Generated Data

Title

Untitled (full-length portrait of husband and wife standing in front of painted backdrop depicting a room interior)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.14056

Human Generated Data

Title

Untitled (full-length portrait of husband and wife standing in front of painted backdrop depicting a room interior)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.14056

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Person 99.1
Human 99.1
Clothing 96.9
Apparel 96.9
Person 96.7
Pants 80
Suit 76.7
Coat 76.7
Overcoat 76.7
Sleeve 72.8
People 72.7
Architecture 63
Building 63
Home Decor 62.3
Pillar 56.2
Column 56.2

Clarifai
created on 2023-10-27

people 100
group 98.8
portrait 98.7
adult 98.6
two 98.2
wear 96.4
administration 96
man 95.9
leader 95.7
woman 95.3
three 95
offspring 94.8
actor 89.9
group together 87.4
child 87
outfit 85.9
prince 85.2
art 84
four 83.9
family 82.8

Imagga
created on 2022-01-28

statue 28
military uniform 25.8
sculpture 24.3
old 23
uniform 20.8
vintage 19
clothing 19
religion 18.8
person 18.5
antique 18.4
art 18
man 17.5
ancient 16.4
people 15.1
groom 14.5
fashion 14.3
monument 14
sexy 13.7
portrait 13.6
model 13.2
historical 13.2
male 12.8
architecture 12.5
god 12.4
covering 12.3
black 12.2
religious 12.2
figure 12.1
dress 11.7
kin 11.5
couple 11.3
suit 11.3
attractive 11.2
style 11.1
culture 11.1
church 11.1
sensual 10.9
consumer goods 10.8
history 10.7
tourism 10.7
posing 10.7
interior 10.6
lady 10.6
adult 10.5
famous 10.2
elegance 10.1
room 10
holy 9.6
spiritual 9.6
hair 9.5
elegant 9.4
stone 9.3
historic 9.2
sensuality 9.1
retro 9
catholic 9
marble 8.7
love 8.7
travel 8.4
dark 8.3
human 8.2
one 8.2
landmark 8.1
romantic 8
carving 7.8
face 7.8
prayer 7.7
pretty 7.7
saint 7.7
faith 7.7
two 7.6
city 7.5
stylish 7.2
body 7.2

Google
created on 2022-01-28

Picture frame 84.8
Vintage clothing 77.6
Blazer 76.4
Formal wear 76
Suit 75.9
Collar 75.7
Tints and shades 74.6
Chair 71.7
Classic 71.5
Room 65.7
History 65.5
Stock photography 65.4
Event 64.7
Retro style 55.9
Visual arts 55.1
Victorian fashion 54.2
Art 52.1
Monochrome 51.9
Antique 51

Microsoft
created on 2022-01-28

clothing 98.6
person 97.7
text 97.2
old 95.1
suit 94.9
posing 91.5
standing 90.4
black 82.4
white 81.6
smile 81
man 78.7
coat 76.6
human face 70.1
vintage clothing 69.9
photograph 62.5
vintage 28
clothes 17.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Female, 100%
Angry 98.9%
Calm 0.4%
Confused 0.3%
Surprised 0.2%
Sad 0%
Fear 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 90.7%
Confused 5%
Disgusted 3.1%
Surprised 0.4%
Happy 0.3%
Angry 0.2%
Sad 0.2%
Fear 0.1%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 35
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Suit
Person 99.1%
Person 96.7%
Suit 76.7%