Human Generated Data

Title

Untitled (young boy posing in living room with brother watching from behind)
Date

1953
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9486

Human Generated Data

Title

Untitled (young boy posing in living room with brother watching from behind)

People

Artist: Martin Schweig, American 20th century

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Furniture 99.8
Person 99.4
Human 99.4
Person 99.3
Clothing 95.3
Shoe 95.3
Footwear 95.3
Apparel 95.3
Shoe 95.1
Chair 92.6
Indoors 87.6
Room 86.6
Table 82.6
Dining Table 82.6
Floor 80.8
Child 72.5
Kid 72.5
Flooring 71.3
Advertisement 70.9
Poster 70.9
Female 70.6
Girl 68.1
Collage 62.4
Pants 62.2
Shorts 61.3
Dining Room 56.4
Shoe 53.8

Imagga
created on 2022-01-23

chair 51.1
room 40.4
table 33.2
classroom 26.8
interior 26.5
musical instrument 26.1
seat 22.9
people 19.5
man 19.5
furniture 18.6
percussion instrument 18.2
floor 17.7
business 17.6
sitting 17.2
male 16.3
house 15.9
office 15.4
home 15.2
person 14.1
modern 14
restaurant 13.7
businessman 13.2
indoors 13.2
wood 12.5
glass 12.4
dining 12.4
lifestyle 12.3
day 11.8
chairs 11.8
wind instrument 11.7
relaxation 11.7
architecture 11.7
work 11.3
style 11.1
inside 11
teacher 11
summer 10.9
vibraphone 10.8
outdoor 10.7
design 10.7
building 10.6
urban 10.5
group 10.5
meeting 10.4
adult 10.2
device 10.2
two 10.2
indoor 10
board 9.9
decor 9.7
sun 9.7
brass 9.5
men 9.4
wall 9.4
window 9.3
dinner 9.3
communication 9.2
outdoors 9
sky 8.9
scene 8.7
comfortable 8.6
empty 8.6
relax 8.4
marimba 8.4
coffee 8.3
city 8.3
plant 8.2
happy 8.1
cheerful 8.1
light 8
smiling 8
women 7.9
tables 7.9
black 7.8
life 7.7
laptop 7.7
hall 7.6
sit 7.6
drink 7.5
study 7.5
computer 7.4
wine 7.4
back 7.3
school 7.3
meal 7.3
success 7.2
decoration 7.2
patio 7.1
job 7.1
working 7.1

Google
created on 2022-01-23

Table 88.5
Standing 86.4
Chair 84.6
Black-and-white 84.3
Art 77.4
Monochrome 75.3
Monochrome photography 72.7
Room 72.5
Toddler 71.8
Illustration 71.6
Vintage clothing 67.5
Stock photography 65.1
Child 64.7
Painting 63
Drawing 61.8
Sitting 61.6
Visual arts 61
Picture frame 55
Photographic paper 54.5
Play 52.8

Microsoft
created on 2022-01-23

text 99.3
toddler 95.4
clothing 86.5
baby 83.5
furniture 77.1
person 75.6
chair 71.1
boy 59.5

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 98.6%
Calm 42.3%
Happy 36.3%
Sad 6.9%
Confused 5.8%
Disgusted 3.3%
Angry 2.9%
Surprised 1.6%
Fear 0.9%

AWS Rekognition

Age 23-33
Gender Male, 92.9%
Sad 44.4%
Calm 23.3%
Fear 17%
Happy 11.2%
Disgusted 2.5%
Surprised 0.7%
Angry 0.6%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Shoe 95.3%
Chair 92.6%

Captions

Microsoft

a person standing in front of a building 62.5%
a boy standing in front of a building 26.8%
a man and a woman standing in front of a building 26.7%

Text analysis

Amazon

10
KODAKEIA

Google

XAGONT
YT37A°2- XAGONT
YT37A°2-