Human Generated Data

Title

Untitled (portrait of four people standing in front of house, circular format)

Date

c. 1890 - c. 1910

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Andrew S. Dibner, P2003.131.16048

Human Generated Data

Title

Untitled (portrait of four people standing in front of house, circular format)

People

Artist: Unidentified Artist,

Date

c. 1890 - c. 1910

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Transportation 99.9
Bike 99.9
Vehicle 99.9
Bicycle 99.9
Wheel 99.3
Machine 99.3
Person 99.2
Human 99.2
Person 98.8
Wheel 97.9
Person 97.7
Person 95.6
Outdoors 85.8
Nature 76.4
Porch 63.8
Painting 60.3
Art 60.3

Imagga
created on 2022-01-29

old 37.6
ancient 30.3
architecture 30
grunge 29.8
vintage 27.4
graffito 24.7
wall 23.5
antique 20.8
city 20
building 18.9
history 18.8
texture 18.8
structure 18.6
decoration 18.2
aged 18.1
dark 17.5
stone 17.1
travel 16.9
art 16.3
grungy 16.1
historical 14.1
tunnel 13.7
dirty 13.6
religion 13.4
retro 13.1
artistic 13
historic 12.8
light 12.7
landmark 12.6
mystery 12.5
night 12.4
church 12
culture 12
tourism 11.5
pattern 10.9
black 10.8
monument 10.3
landscape 9.7
house 9.6
textured 9.6
urban 9.6
medieval 9.6
worn 9.5
old fashioned 9.5
fantasy 9
temple 8.9
brown 8.8
crumpled 8.7
paper 8.6
season 8.6
canvas 8.5
tree 8.5
scenery 8.1
material 8
brick 7.9
darkness 7.8
mysterious 7.8
horror 7.8
fear 7.7
stain 7.7
rustic 7.7
damaged 7.6
decorative 7.5
frame 7.5
graphic 7.3
rough 7.3
yellow 7.3
cathedral 7.2
tower 7.2

Google
created on 2022-01-29

Wheel 93.8
Bicycle 92.9
Black 89.6
Rectangle 82.3
Tree 81.3
Bicycle wheel rim 79.6
Art 78.1
Tints and shades 77.4
Building 72.9
Room 70.7
Bicycle wheel 70.3
Visual arts 69.6
Tire 68.7
Circle 68.2
History 65.4
Stock photography 65.3
Antique 63.1
Vintage clothing 61
Arch 60.4
Wood 57.8

Microsoft
created on 2022-01-29

text 99.8
bicycle 91.9
old 91.2
land vehicle 67.4
bicycle wheel 60.5
vehicle 58.6
wheel 52.2
vintage 29.3

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 99.8%
Calm 99.7%
Happy 0.1%
Sad 0%
Confused 0%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Female, 99.9%
Angry 88.5%
Calm 6.9%
Sad 2.5%
Disgusted 0.6%
Confused 0.6%
Happy 0.4%
Surprised 0.3%
Fear 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.7%
Calm 96.9%
Happy 2%
Surprised 0.8%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Sad 0%

AWS Rekognition

Age 48-56
Gender Male, 75.3%
Happy 99.6%
Calm 0.2%
Surprised 0.1%
Sad 0%
Fear 0%
Angry 0%
Confused 0%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Unlikely

Feature analysis

Amazon

Bicycle 99.9%
Wheel 99.3%
Person 99.2%
Painting 60.3%

Captions

Microsoft

a vintage photo of an old building 82.2%
a vintage photo of a person 79.9%
a vintage photo of a person standing in front of a building 74%