Human Generated Data

Title

Untitled (Roy Rogers restaurant)

Date

1975

People

Artist: Sage Sohier, American born 1954

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1128

Copyright

© Sage Sohier

Human Generated Data

Title

Untitled (Roy Rogers restaurant)

People

Artist: Sage Sohier, American born 1954

Date

1975

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.5
Human 99.5
Person 98.9
Person 98.2
Person 98.2
Ball 90.1
Balloon 84.5
Interior Design 84.2
Indoors 84.2
Room 78.2
Person 77.7
People 68.7
Living Room 62.7
Collage 56.2
Advertisement 56.2
Poster 56.2
Housing 55.6
Building 55.6
Bedroom 55.5

Imagga
created on 2022-01-09

salon 49.2
barbershop 45
shop 39.3
window 31.3
mercantile establishment 28.2
interior 26.5
home 26.3
room 26
house 24.2
architecture 21.8
modern 21.7
place of business 18.8
indoors 18.4
television 16.5
furniture 16.5
indoor 16.4
business 15.2
man 14.8
design 14.6
building 14.2
chair 14.1
light 14
black 13.8
people 13.4
lifestyle 13
office 13
luxury 12.9
glass 12.4
male 12
inside 12
table 11.5
floor 11.1
3d 10.8
apartment 10.5
empty 10.3
wood 10
kitchen 9.8
working 9.7
case 9.7
windows 9.6
wall 9.4
establishment 9.4
person 9.1
adult 9
open 9
technology 8.9
style 8.9
decor 8.8
computer 8.8
back 8.3
monitor 8.2
cabinet 8.1
domestic 8.1
looking 8
structure 8
decoration 8
urban 7.9
work 7.8
hairdresser 7.8
men 7.7
living 7.6
door 7.5
contemporary 7.5
telecommunication system 7.3
new 7.3
lamp 7.2
worker 7.2
women 7.1
travel 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

wall 97.7
indoor 95.3
text 85.7
person 79.7
clothing 74
black and white 61.6
furniture 31.2

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Female, 99.4%
Fear 49.4%
Sad 44.1%
Calm 2%
Confused 1.8%
Disgusted 1.4%
Happy 0.5%
Angry 0.5%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a person sitting in a room 83.1%
a person sitting in a room 76.6%
a person standing in front of a mirror posing for the camera 64.4%

Text analysis

Amazon

Rogers
Roy Rogers
Roy
AX