Human Generated Data

Title

Untitled (mother and four children seated on couch in front of fireplace)

Date

c. 1950

People

Artist: Paul Gittings, American 1900 - 1988

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12539

Human Generated Data

Title

Untitled (mother and four children seated on couch in front of fireplace)

People

Artist: Paul Gittings, American 1900 - 1988

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.2
Person 99.2
Person 99
Apparel 99
Clothing 99
Person 98.8
Person 98.8
Chair 98.2
Furniture 98.2
Person 98.2
Footwear 92.8
Shoe 92.8
Coat 85.4
Suit 85.4
Overcoat 85.4
People 85.2
Sitting 82.4
Female 75.9
Shoe 71.3
Tie 67.3
Accessories 67.3
Accessory 67.3
Photo 63
Photography 63
Fashion 62.7
Robe 62.7
Flooring 60.2
Gown 59.4
Dress 59.2
Woman 59.1
Lamp 58.3
Couch 56.9
Family 56.2
Indoors 55.7
Wedding 55.6
Evening Dress 55.3

Imagga
created on 2022-01-29

nurse 39.8
person 38.7
people 32.3
man 31.6
adult 28.5
male 28.3
businessman 28.2
professional 25
business 24.3
patient 24.3
teacher 23.5
men 22.3
group 19.3
smiling 18.8
happy 18.2
educator 17.7
office 17.7
case 15.8
colleagues 15.5
30s 15.4
room 15.2
sick person 15.2
women 15
indoors 14.9
worker 14.8
40s 14.6
businesswoman 14.5
team 14.3
job 13.3
black 13.2
couple 13.1
teamwork 13
smile 12.8
working 12.4
businesspeople 12.3
color 12.2
standing 12.2
portrait 11.6
four 11.5
desk 11.3
meeting 11.3
corporate 11.2
sitting 11.2
mature 11.1
two 11
20s 11
mid adult 10.6
together 10.5
executive 10.4
clothing 10.4
happiness 10.2
suit 9.9
forties 9.8
cheerful 9.7
medical 9.7
talking 9.5
lifestyle 9.4
life 9.3
associates 8.8
coworkers 8.8
home 8.8
classroom 8.6
casual 8.5
manager 8.4
human 8.2
hospital 8.2
mother 8
handsome 8
world 8
four people 7.9
work 7.8
day 7.8
casual clothing 7.8
thirties 7.8
diversity 7.7
player 7.6
adults 7.6
holding 7.4
camera 7.4
inside 7.4
success 7.2
history 7.2
family 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 97.5
person 94.5
clothing 93.9
sport 85.2
footwear 74.6
woman 71.5
dress 59
posing 52.8

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Female, 89.2%
Happy 81.2%
Surprised 4.8%
Calm 4.4%
Sad 3.5%
Angry 2.7%
Disgusted 1.4%
Fear 1.3%
Confused 0.7%

AWS Rekognition

Age 33-41
Gender Female, 64.2%
Happy 97.3%
Surprised 1.4%
Calm 0.6%
Disgusted 0.3%
Confused 0.2%
Angry 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Happy 95.9%
Sad 1.1%
Calm 1.1%
Surprised 0.8%
Angry 0.4%
Confused 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Male, 88.6%
Happy 98.3%
Surprised 0.6%
Calm 0.3%
Sad 0.3%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 22-30
Gender Male, 93.7%
Happy 80.7%
Calm 9.8%
Surprised 6.8%
Angry 1.2%
Sad 0.9%
Disgusted 0.4%
Confused 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Shoe 92.8%
Tie 67.3%

Captions

Microsoft

a group of people posing for a photo 87.4%
a group of people posing for the camera 87.3%
a group of people posing for a picture 87.2%

Text analysis

Amazon

YT33A2
MJIR YT33A2 ОСНИ
MJIR
a
a ........
........
ОСНИ