Human Generated Data

Title

Untitled (full-length portrait of standing boy and seated girl in front of painted backdrop depicting a room interior)
Date

c. 1856 - c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13902

Human Generated Data

Title

Untitled (full-length portrait of standing boy and seated girl in front of painted backdrop depicting a room interior)

People

Artist: Unidentified Artist,

Date

c. 1856 - c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.13902

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Clothing 99.8
Apparel 99.8
Person 99
Human 99
Person 98.4
Shoe 91.6
Footwear 91.6
People 80.2
Shoe 78.4
Furniture 73.4
Coat 67.1
Hat 63.6
Sitting 57.4
Photography 57.1
Photo 57.1
Boot 56.1

Clarifai
created on 2023-10-27

people 99.9
two 99.1
child 99
wear 97.6
portrait 97.5
woman 95.3
son 95.1
adult 94.7
offspring 94.6
retro 93.8
man 92.6
sepia 92.2
family 91.6
group 88.7
princess 88.5
three 88.1
sibling 86.7
nostalgia 86.3
actress 86.1
boy 84.8

Imagga
created on 2022-01-28

military uniform 100
uniform 100
clothing 79.1
covering 52.5
consumer goods 52.2
man 33.6
people 29
commodity 25.8
male 24.8
adult 22.3
person 22
portrait 18.1
happy 17.5
home 15.2
family 14.2
face 14.2
old 13.9
attractive 13.3
senior 13.1
couple 13.1
lifestyle 13
two 11.9
room 11.6
smile 11.4
human 11.2
casual 11
happiness 11
playing 10.9
black 10.8
fun 10.5
business 10.3
mature 10.2
dress 9.9
child 9.8
fashion 9.8
interior 9.7
indoors 9.7
office 9.6
elderly 9.6
love 9.5
innocent 9.4
mother 9.3
school 9.2
alone 9.1
aged 9.1
job 8.8
businessman 8.8
medical 8.8
smiling 8.7
men 8.6
gun 8.4
health 8.3
vintage 8.3
occupation 8.2
to 8
women 7.9
together 7.9
boy 7.8
standing 7.8
soldier 7.8
army 7.8
military 7.7
pretty 7.7
illness 7.6
professional 7.5
relationship 7.5
one 7.5
cheerful 7.3
lady 7.3
looking 7.2
hair 7.1
handsome 7.1
kid 7.1
work 7.1

Google
created on 2022-01-28

Footwear 98.1
Photograph 94.2
Chair 83.1
Vintage clothing 76.3
Snapshot 74.3
Classic 74.2
Tints and shades 73.5
Boot 72.6
Suit 68.2
Sitting 67
Stock photography 66.8
Child 60.1
Uniform 58
Retro style 56.9
Art 55.3
History 53.2
Room 52.8
Family 51.9
Toddler 51.2
Vintage advertisement 51

Microsoft
created on 2022-01-28

text 99.3
person 99
clothing 98.8
human face 96.2
posing 90.6
smile 78.4
old 77.8
child 74.3
white 61.9
toddler 57.8
woman 51.3
dressed 30

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-10
Gender Male, 99.9%
Calm 62.7%
Sad 27.8%
Angry 8.2%
Confused 0.5%
Happy 0.3%
Fear 0.2%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 6-12
Gender Female, 100%
Calm 91.8%
Sad 5.4%
Confused 0.9%
Angry 0.8%
Fear 0.4%
Surprised 0.3%
Disgusted 0.2%
Happy 0.1%

Microsoft Cognitive Services

Age 10
Gender Male

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99%
Person 98.4%
Shoe 91.6%
Shoe 78.4%

Categories

Imagga

people portraits 98.4%