Human Generated Data

Title

Untitled (family in living room)
Date

c. 1950
People

Artist: Mary Lowber Tiers, American active 1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15861.1

Human Generated Data

Title

Untitled (family in living room)

People

Artist: Mary Lowber Tiers, American active 1940s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 99.5
Human 99.5
Person 98.7
Furniture 97.2
Person 90
Person 87.5
Living Room 86.8
Room 86.8
Indoors 86.8
Face 70.3
Text 68.7
Chair 68
Couch 65.3
Person 64.8
Cabinet 64.1
People 63.9
Electronics 58
Monitor 58
Display 58
Screen 58
LCD Screen 57.8
Bedroom 56.1
Senior Citizen 55.4

Imagga
created on 2022-02-05

person 36.6
man 34.9
people 32.4
adult 31.1
home 30.3
male 28.4
office 27.6
laptop 26.6
computer 26.1
room 25.7
smiling 23.9
happy 23.2
indoors 22.8
patient 22.3
sitting 21.5
business 21.3
work 20.4
working 20.3
professional 19.9
businessman 19.4
lifestyle 18.8
table 18.7
couple 18.3
meeting 17.9
smile 17.8
technology 17.8
indoor 17.3
computerized axial tomography scanner 17.2
group 16.9
senior 16.9
desk 16.6
businesswoman 16.4
women 15.8
together 14.9
portrait 14.9
corporate 14.6
communication 14.3
job 14.2
happiness 14.1
education 13.9
cheerful 13.8
men 13.7
looking 13.6
executive 13.5
house 13.4
team 12.5
family 12.5
worker 12.4
interior 12.4
case 12.2
hand 12.2
occupation 11.9
husband 11.4
hospital 11.4
talking 11.4
wife 11.4
career 11.4
modern 11.2
classroom 11.2
sick person 11.2
mature 11.2
x-ray machine 10.9
handsome 10.7
attractive 10.5
businesspeople 10.4
doctor 10.3
keyboard 10.3
teamwork 10.2
casual 10.2
two 10.2
20s 10.1
screen 10.1
to 9.7
specialist 9.7
couch 9.7
mid adult 9.6
bed 9.5
television 9.5
face 9.2
horizontal 9.2
confident 9.1
health 9
suit 9
medical 8.8
notebook 8.7
clinic 8.6
formal 8.6
manager 8.4
fun 8.2
care 8.2
one 8.2
lady 8.1
newspaper 8
bright 7.9
iron lung 7.8
two people 7.8
pretty 7.7
elderly 7.7
equipment 7.7
wireless 7.6
sit 7.6
lying 7.5
human 7.5
student 7.5
apparatus 7.4
life 7.3
teacher 7.3
window 7

Google
created on 2022-02-05

Photograph 94.3
White 92.2
Black 89.8
Black-and-white 84
Style 83.9
Art 79.4
Monochrome 78.8
Monochrome photography 77.7
Technology 77.4
Font 75.6
Snapshot 74.3
Circle 73.3
Room 72.9
Picture frame 67.9
Vintage clothing 67.6
Event 66.9
Stock photography 66.5
Hat 59.6
Photo caption 59.5
Still life photography 57.5

Microsoft
created on 2022-02-05

text 99.6
person 84.3
human face 82.4
clothing 79.2
picture frame 73.4
posing 55.8

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 92.8%
Calm 86.4%
Confused 3.6%
Disgusted 3%
Happy 2.4%
Sad 1.5%
Fear 1.3%
Angry 1%
Surprised 0.9%

AWS Rekognition

Age 31-41
Gender Male, 99.5%
Disgusted 37.8%
Sad 18.2%
Confused 18%
Angry 12.2%
Happy 5.4%
Calm 3.3%
Surprised 2.8%
Fear 2.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people posing for a photo 88.4%
a group of people posing for the camera 88.3%
a group of people posing for a picture 88.2%

Text analysis

Amazon

F
KODAK SAFETY F
KODAK
SAFETY
SAFETY FILM
FILM
4
C
...

Google

S'AFETY FILM KODAK S'AFETY
S'AFETY
FILM
KODAK