Human Generated Data

Title

Untitled (man giving toast, fountain on table)

Date

1955

People

Artist: Bachrach Studios, founded 1868

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18982

Human Generated Data

Title

Untitled (man giving toast, fountain on table)

People

Artist: Bachrach Studios, founded 1868

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 99.4
Person 99.4
Person 98.5
Art 65.5
Water 58.3
Mannequin 56.3

Imagga
created on 2022-03-05

fountain 30.5
glass 22.9
washbasin 22.4
structure 22.1
basin 19.8
container 19.8
vessel 18.9
old 18.8
antique 18
architecture 17.4
decoration 13.7
scale 13.4
sculpture 12.5
ancient 12.1
garden 11.7
drink 11.7
statue 11.7
wood 11.7
goblet 11.3
table 11.2
stone 11
religion 10.7
vintage 10.7
furniture 10.6
wall 10.6
detail 10.5
column 10.3
traditional 10
decor 9.7
cup 9.4
lamp 9.4
classic 9.3
building 9.2
travel 9.1
pedestal 9.1
retro 9
interior 8.8
light 8.7
old fashioned 8.6
pot 8.5
design 8.4
measuring instrument 8.4
room 8.3
landmark 8.1
support 8.1
instrument 8.1
wooden 7.9
food 7.8
art 7.6
kitchen 7.5
house 7.5
place 7.4
gold 7.4
brown 7.4
metal 7.2
carving 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

black and white 93.6
vase 92.1
text 87.4
indoor 87
person 77
clothing 74.5
man 64.5
old 45
several 11

Face analysis

Amazon

Google

AWS Rekognition

Age 48-56
Gender Male, 99.5%
Sad 93.6%
Confused 2.3%
Disgusted 1.1%
Fear 0.8%
Surprised 0.8%
Angry 0.7%
Happy 0.5%
Calm 0.2%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Happy 42.9%
Angry 29.8%
Calm 13.5%
Sad 7.3%
Surprised 2.7%
Fear 1.4%
Disgusted 1.3%
Confused 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 51.1%
a group of people standing in front of a mirror posing for the camera 46.2%
a person standing in front of a mirror 46.1%

Text analysis

Amazon

03
SS
THE

Google

2--XACOX
RA 2--XACOX
RA