Human Generated Data

Title

Untitled (six member family posed sitting in living room with baby and toy horse in center)

Date

1951

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9441

Human Generated Data

Title

Untitled (six member family posed sitting in living room with baby and toy horse in center)

People

Artist: Martin Schweig, American 20th century

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 99.6
Apparel 99.6
Human 98.9
Person 98.9
Person 98.7
Person 98.7
Person 98.5
Person 98.5
Person 98.4
Chair 98
Furniture 98
Indoors 87
Face 83.6
Shorts 81.7
Shirt 76.3
Female 74.8
Tie 73.8
Accessory 73.8
Accessories 73.8
Room 71.5
Child 71.3
Kid 71.3
Floor 71.1
Photo 69.3
Portrait 69.3
Photography 69.3
Girl 66.7
Overcoat 65.3
Suit 65.3
Coat 65.3
Flooring 64.2
Sitting 62.4
Stage 62.2
Food 58
Icing 58
Cream 58
Creme 58
Dessert 58
Cake 58
Baby 56.7
Screen 55.9
Electronics 55.9

Imagga
created on 2022-01-23

man 43.7
person 40.5
people 35.7
male 33.3
business 32.8
businessman 31.8
adult 30.4
office 29.5
professional 27.5
patient 26.9
happy 25.1
laptop 24.8
job 23
businesswoman 22.7
working 22.1
work 22
sitting 21.5
meeting 20.7
case 20.7
men 20.6
businesspeople 19.9
corporate 19.8
group 19.3
indoors 19.3
computer 19.3
sick person 18.9
smiling 18.8
together 17.5
worker 17.5
couple 17.4
nurse 17
team 17
teamwork 16.7
lifestyle 16.6
happiness 15.7
table 15.6
desk 15.1
senior 15
smile 15
executive 14.8
kin 14.7
looking 14.4
home 14.4
room 14.2
manager 14
cheerful 13.8
success 13.7
casual 13.6
talking 13.3
colleagues 12.6
technology 12.6
indoor 11.9
women 11.9
communication 11.8
30s 11.5
workplace 11.4
groom 11.4
coat 11.2
lab coat 11.2
paper 10.3
mature 10.2
document 10.2
face 9.9
grandfather 9.9
suit 9.9
coworkers 9.8
handsome 9.8
teacher 9.8
mid adult 9.6
clothing 9.6
love 9.5
two 9.3
camera 9.2
20s 9.2
successful 9.1
counter 8.7
retirement 8.6
ethnic 8.6
reading 8.6
finance 8.4
portrait 8.4
modern 8.4
attractive 8.4
building 8.3
new 8.1
interior 8
color 7.8
elderly 7.7
employee 7.6
career 7.6
horizontal 7.5
keyboard 7.5
holding 7.4
chair 7.4
phone 7.4
occupation 7.3
confident 7.3

Google
created on 2022-01-23

Motor vehicle 74.5
Monochrome 71.5
Font 71.4
Vintage clothing 68.8
Crew 68.1
Event 67.8
Room 66.2
Suit 64.9
Monochrome photography 64.6
Recreation 63.2
Team 62.6
T-shirt 62.6
Art 62.4
Photo caption 62.1
Classic 60.7
Advertising 60.2
Photographic paper 52.4
History 51.8
Uniform 51.4
Service 51

Microsoft
created on 2022-01-23

person 98.6
text 97.3
clothing 94.1
black and white 81.4
man 78.4
posing 41.4

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 95.4%
Calm 99.2%
Happy 0.2%
Surprised 0.2%
Sad 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 99.8%
Surprised 44.7%
Sad 27.3%
Calm 6.4%
Disgusted 5.7%
Confused 5.3%
Angry 5%
Fear 3.8%
Happy 1.8%

AWS Rekognition

Age 29-39
Gender Male, 77.6%
Happy 72.1%
Calm 23.5%
Surprised 1.2%
Sad 1.1%
Disgusted 0.8%
Confused 0.4%
Fear 0.4%
Angry 0.4%

AWS Rekognition

Age 45-53
Gender Male, 90.1%
Calm 78%
Sad 7.1%
Surprised 7%
Confused 2.8%
Angry 1.7%
Disgusted 1.7%
Fear 1.1%
Happy 0.6%

AWS Rekognition

Age 38-46
Gender Male, 95.2%
Happy 62.4%
Surprised 15.6%
Calm 8.5%
Confused 3.7%
Fear 3.6%
Disgusted 2.2%
Sad 2.2%
Angry 2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Tie 73.8%

Captions

Microsoft

a group of people posing for a photo 85.3%
a group of people posing for the camera 85.2%
a group of people posing for a picture 85.1%