Human Generated Data

Title

Untitled (African natives in uniform)

Date

1910s

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3173

Human Generated Data

Title

Untitled (African natives in uniform)

People

Artist: Unidentified Artist,

Date

1910s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.7
Human 99.7
Person 99.6
Person 99.6
Person 99.5
Person 99.5
Person 99.4
Person 99.3
Person 99.2
Person 99.2
Person 98.9
Person 97.8
Person 94.3
Person 90.3
Crowd 86.8
People 85.4
Painting 84.9
Art 84.9
Nature 84
Person 81
Plant 79.1
Tree 78.5
Outdoors 76.5
Arecaceae 73.6
Palm Tree 73.6
Clothing 70.9
Apparel 70.9
Shorts 70.9
Troop 66
Military Uniform 66
Army 66
Military 66
Armored 66
Person 62
Person 48.8

Imagga
created on 2022-01-08

sketch 36.1
drawing 35.5
representation 23.4
silhouette 23.2
tree 22
grunge 19.6
landscape 19.3
sunset 18
sun 16.4
texture 15.3
vintage 15
art 14.8
sky 14.7
design 14.1
natural 14
light 14
structure 14
old 13.9
forest 13.9
water 13.3
aged 12.7
black 12.1
dark 11.7
pattern 11.6
antique 11.2
evening 11.2
tropical 11.1
summer 10.9
horizon 10.8
holiday 10.8
orange 10.7
tourism 10.7
dawn 10.6
palm 10.3
cemetery 10.2
graphic 10.2
wall 10.1
outdoor 9.9
travel 9.9
trees 9.8
group 9.7
autumn 9.7
style 9.6
ancient 9.5
people 9.5
space 9.3
tracing 9.2
wood 9.2
park 9.1
dirty 9
night 8.9
scenic 8.8
mysterious 8.7
man 8.7
artistic 8.7
stain 8.6
paper 8.6
party 8.6
dusk 8.6
season 8.6
sunrise 8.4
wallpaper 8.4
dance 8.4
field 8.4
environment 8.2
effect 8.2
decoration 8.2
morning 8.1
backgrounds 8.1
brown 8.1
snow 7.9
spring 7.8
silhouettes 7.8
fog 7.7
mystery 7.7
crowd 7.7
tracery 7.5
ocean 7.5
plants 7.4
glow 7.4
vacation 7.4
border 7.2
scenery 7.2
architecture 7.2
shadow 7.2
wet 7.2
material 7.1
grass 7.1
male 7.1
ice 7.1
land 7

Google
created on 2022-01-08

Tree 86.5
Adaptation 79.2
Plant 79
Arecales 74.7
Art 74.2
Vintage clothing 72.1
Event 69.7
Palm tree 68.7
Font 68.1
Room 68
Suit 67.3
History 67
Stock photography 65
Uniform 64.8
Visual arts 64.6
Paper product 62.8
Team 60.4
Crew 58.3
Illustration 51.7

Microsoft
created on 2022-01-08

text 97.3
group 88.4
palm tree 86.4
tree 65.7
posing 64.1
people 63

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 95.8%
Sad 2.4%
Confused 0.8%
Angry 0.7%
Disgusted 0.1%
Surprised 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 34-42
Gender Male, 98%
Sad 96.7%
Calm 2.3%
Confused 0.3%
Happy 0.1%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Sad 78.7%
Calm 18%
Angry 0.9%
Confused 0.8%
Disgusted 0.7%
Happy 0.3%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 95.7%
Sad 4%
Confused 0.1%
Angry 0.1%
Happy 0.1%
Fear 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 47-53
Gender Male, 99.7%
Sad 72.8%
Fear 19%
Calm 5%
Angry 2.2%
Disgusted 0.3%
Confused 0.3%
Happy 0.2%
Surprised 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.7%
Sad 53.7%
Calm 38.7%
Confused 2.7%
Fear 1.6%
Angry 1.4%
Disgusted 1.1%
Surprised 0.4%
Happy 0.4%

AWS Rekognition

Age 23-31
Gender Male, 99.8%
Calm 76.4%
Sad 11.4%
Fear 6.1%
Confused 3.4%
Surprised 0.9%
Disgusted 0.8%
Angry 0.6%
Happy 0.4%

AWS Rekognition

Age 45-51
Gender Male, 100%
Calm 56.3%
Confused 21.5%
Sad 13.6%
Disgusted 2.5%
Fear 2.4%
Angry 1.3%
Surprised 1.3%
Happy 1.1%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 88.6%
Sad 8%
Confused 2.1%
Angry 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 42-50
Gender Male, 99.8%
Calm 80.9%
Sad 12.8%
Fear 2.3%
Confused 1.6%
Angry 1.2%
Disgusted 0.8%
Happy 0.2%
Surprised 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Sad 81.7%
Calm 13.8%
Confused 2%
Disgusted 0.7%
Angry 0.5%
Fear 0.5%
Surprised 0.4%
Happy 0.3%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Sad 74.5%
Calm 13%
Disgusted 4.6%
Angry 3.3%
Fear 1.9%
Surprised 1.1%
Confused 1%
Happy 0.5%

AWS Rekognition

Age 31-41
Gender Male, 100%
Calm 74.7%
Sad 19.3%
Confused 4.5%
Disgusted 0.4%
Surprised 0.3%
Angry 0.3%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 22-30
Gender Male, 98.4%
Calm 62.4%
Sad 13.1%
Confused 11.1%
Angry 5.7%
Surprised 4.6%
Fear 1.7%
Disgusted 1.1%
Happy 0.4%

AWS Rekognition

Age 28-38
Gender Male, 98.6%
Calm 50.8%
Confused 41.5%
Sad 2.5%
Surprised 2.2%
Angry 2.1%
Disgusted 0.5%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 13-21
Gender Female, 99.4%
Calm 86%
Sad 4.5%
Confused 3.6%
Fear 1.9%
Surprised 1.7%
Happy 1.1%
Angry 0.7%
Disgusted 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.7%
Painting 84.9%

Captions

Microsoft

a group of people posing for a photo 93.7%
a group of people posing for a picture 93.6%
a group of people posing for the camera 93.5%

Text analysis

Amazon

ISC
PREVENTIVE
XOT