Human Generated Data

Title

Untitled (man and baby looking into mirror)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17386

Human Generated Data

Title

Untitled (man and baby looking into mirror)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 98.5
Human 98.5
Person 97.8
Person 91.1
Person 87.9
Clothing 85
Apparel 85
Indoors 80.6
Room 80.6
Face 74.9
Furniture 71.9
Plant 70
Photo 66.5
Portrait 66.5
Photography 66.5
Mirror 61.7
Food 58.8
Meal 58.8
Female 58.5

Imagga
created on 2022-02-26

person 23.3
digital 21.9
computerized axial tomography scanner 20.1
device 20
technology 18.6
globe 17.6
aviator 16.3
light 16
disk jockey 15.9
color 13.9
earth 13.7
science 13.3
planet 13.2
global 12.8
broadcaster 12.7
x-ray machine 12.7
3d 12.4
motion 12
modern 11.2
ventilator 11.2
people 11.2
world 11
spotlight 11
adult 11
connection 11
business 10.9
black 10.8
lamp 10.8
wallpaper 10.7
design 10.7
equipment 10.7
attractive 10.5
style 10.4
render 10.4
graphic 10.2
network 10.2
space 10.1
man 10.1
communication 10.1
bass 10
communicator 9.5
decoration 9.4
map 9.3
future 9.3
art 9.3
male 9.2
electric fan 9.1
pretty 9.1
human 9
glass 9
lady 8.9
apparatus 8.9
medical 8.8
computer 8.8
virtual 8.7
work 8.6
face 8.5
web 8.5
portrait 8.4
fantasy 8.1
star 8.1
reflection 8
looking 8
night 8
information 8
conceptual 7.9
bright 7.9
continent 7.8
washer 7.7
international 7.6
graphics 7.6
studio 7.6
fashion 7.5
holding 7.4
mask 7.3
fan 7.2
futuristic 7.2
transparent 7.2
shiny 7.1
working 7.1
businessman 7.1
ball 7.1

Google
created on 2022-02-26

Shirt 94.1
Hat 85.7
Gesture 85.3
Black-and-white 85.2
Style 84.1
Grey 84
Font 81.4
Music 75.8
Monochrome 75.4
Monochrome photography 75
Circle 74.6
Art 74.5
Entertainment 69
Event 68.3
Suit 67.9
T-shirt 67.5
Fedora 67.3
Glass 66
Audio equipment 65.8
Visual arts 64.9

Microsoft
created on 2022-02-26

text 95.5
person 86
clothing 78.4

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 93.4%
Calm 60.1%
Happy 14.9%
Sad 10.5%
Surprised 9%
Confused 2.4%
Disgusted 1.5%
Angry 1.2%
Fear 0.3%

AWS Rekognition

Age 0-4
Gender Male, 96.1%
Calm 90.4%
Sad 6%
Angry 1.1%
Disgusted 1%
Confused 0.5%
Fear 0.4%
Surprised 0.3%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 31.3%
a person standing in front of a mirror 31.2%
a person standing in front of a mirror posing for the camera 31.1%

Text analysis

Amazon

BSS
VAGGY