Human Generated Data

Title

Untitled (horizontal portrait of group posed behind faux staircase and in front of painted backdrop of doorway)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13078

Human Generated Data

Title

Untitled (horizontal portrait of group posed behind faux staircase and in front of painted backdrop of doorway)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13078

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Person 99.5
Human 99.5
Person 99.5
Person 99.2
Person 99.1
Person 98.9
Person 98.8
Person 97.4
Person 96.5
People 94.2
Clothing 87.5
Apparel 87.5
Family 79.4
Military Uniform 75.8
Military 75.8
Officer 68.8
Handrail 63.5
Banister 63.5
Shorts 62.9
Porch 57.6
Archaeology 57.5
Army 57.4
Armored 57.4
Soldier 56.2
Jury 55.7

Clarifai
created on 2023-10-27

people 99.9
child 99.6
group 98.9
son 98.4
portrait 98.2
man 96.6
family 96.3
woman 95.5
sepia 95.4
adult 95.2
offspring 94.6
boy 93.3
documentary 92.2
art 91.6
sibling 90.9
furniture 90.8
wear 88.6
sit 88.6
street 88.1
princess 87.2

Imagga
created on 2022-01-24

kin 100
sculpture 25.1
statue 24.9
religion 23.3
art 22.2
old 20.9
ancient 19.9
antique 17.3
stone 17
history 16.1
man 15.5
people 14.5
vintage 14.1
architecture 14.1
historic 13.8
god 13.4
religious 13.1
monument 13.1
culture 12.8
grunge 12.8
person 12.3
decoration 11.9
currency 11.7
spirituality 11.5
face 11.4
historical 11.3
dollar 11.1
money 11.1
portrait 11
carving 10.8
sepia 10.7
marble 10.7
one 10.5
church 10.2
cash 10.1
male 9.9
business 9.7
world 9.3
travel 9.2
figure 9.1
detail 8.9
symbol 8.8
temple 8.5
finance 8.4
dark 8.4
tourism 8.3
closeup 8.1
bank 8.1
grave 7.9
golden 7.7
death 7.7
bill 7.6
head 7.6
sign 7.5
design 7.4
dirty 7.2
paper 7.1

Google
created on 2022-01-24

Musical instrument 79.7
Suit 79.4
Art 78.7
Vintage clothing 76.7
Classic 75.8
Rectangle 75.5
Painting 73.7
Visual arts 69.2
History 68.5
Room 66.4
Motor vehicle 65.2
Illustration 64.4
Antique 64.2
Stock photography 62
Font 60.8
Holy places 58.1
Collection 57.7
Retro style 56.3
House 55.5
Recreation 55.3

Microsoft
created on 2022-01-24

text 97.6
clothing 96.1
person 93.5
man 73.5
posing 69.2
old 61.5
human face 55.2
store 46.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 61.7%
Calm 99.1%
Confused 0.3%
Happy 0.2%
Surprised 0.1%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 99.9%
Calm 80.1%
Sad 18.3%
Confused 0.9%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.8%
Calm 97.6%
Confused 1.4%
Sad 0.5%
Angry 0.2%
Happy 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 33-41
Gender Female, 99.9%
Calm 97.4%
Confused 0.8%
Happy 0.7%
Sad 0.3%
Disgusted 0.3%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Female, 99.7%
Calm 99.9%
Confused 0%
Angry 0%
Surprised 0%
Fear 0%
Sad 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Male, 99.9%
Calm 99.8%
Angry 0%
Confused 0%
Sad 0%
Surprised 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 99.9%
Sad 0%
Angry 0%
Happy 0%
Surprised 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 11-19
Gender Female, 99.8%
Calm 96.7%
Confused 1%
Angry 0.7%
Sad 0.5%
Surprised 0.3%
Disgusted 0.3%
Fear 0.3%
Happy 0.2%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 35
Gender Female

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 20
Gender Male

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 15
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person
Person 99.5%
Person 99.5%
Person 99.2%
Person 99.1%
Person 98.9%
Person 98.8%
Person 97.4%
Person 96.5%

Text analysis

Google

EXIS
EXIS