Human Generated Data

Title

Untitled (dancer)
Date

c. 1925
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.739

Human Generated Data

Title

Untitled (dancer)

People

Artist: Martin Schweig, American 20th century

Date

c. 1925

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.7
Human 99.7
Person 99.7
Person 99.6
Person 99.6
Person 99.6
Person 99.6
Person 99.5
Person 99.2
Person 99.1
Person 98.9
Military 98
Person 97.2
Person 97.1
Military Uniform 97
Troop 94.7
People 94.7
Army 94.7
Armored 94.7
Marching 91.6
Crowd 91.6
Officer 88
Soldier 80.3
Person 46.2

Imagga
created on 2022-01-08

landscape 30.5
grass 29.2
fence 27.2
tree 27
forest 25.2
trees 23.1
park 22.2
picket fence 21.6
military uniform 21.4
sky 19.8
rural 19.4
autumn 18.4
scenic 18.4
uniform 18.3
countryside 18.3
field 17.6
outdoors 17.3
barrier 17.3
sun 16.9
leaves 16.6
fall 16.3
country 15.8
summer 15.4
foliage 14.7
outdoor 14.5
clouds 14.4
clothing 14.3
cemetery 13.5
travel 13.4
old 13.2
scene 13
peaceful 12.8
wood 12.5
woods 12.4
environment 12.3
outside 12
sunny 11.2
obstruction 10
scenery 9.9
sunlight 9.8
colors 9.7
branches 9.6
light 9.4
leaf 9.3
covering 9
sunset 9
structure 9
meadow 9
fog 8.7
colorful 8.6
architecture 8.6
consumer goods 8.6
sunrise 8.4
garden 8.4
morning 8.1
road 8.1
group 8.1
farm 8
water 8
spring 7.8
world 7.7
walking 7.6
path 7.6
silhouette 7.4
tourism 7.4
land 7.4
natural 7.4
historic 7.3
peace 7.3
yellow 7.3
landmark 7.2
horizon 7.2
history 7.2
tool 7.1
life 7.1
mountain 7.1
sea 7

Google
created on 2022-01-08

Tree 88.5
Military person 88.4
Gesture 85.3
Sky 83.1
Soldier 82.8
Plant 79.5
Military uniform 79.3
Military organization 77.1
Crew 75.2
Infantry 72.5
Non-commissioned officer 70.9
Uniform 70.7
Army 69
Squad 68.6
Team 67.2
Military rank 67.2
Military 65.7
Military officer 65.4
Flag 64.5
Stock photography 62.4

Microsoft
created on 2022-01-08

tree 99.4
outdoor 96.5
standing 92.8
person 90.5
posing 87.8
clothing 87.7
man 82.7
text 81.6
group 80.4
black 68.3

Face analysis

Amazon

Google

AWS Rekognition

Age 18-24
Gender Female, 100%
Happy 99.6%
Sad 0.1%
Surprised 0.1%
Calm 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%
Angry 0%

AWS Rekognition

Age 22-30
Gender Female, 100%
Happy 99.7%
Surprised 0.1%
Disgusted 0.1%
Angry 0%
Calm 0%
Confused 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 25-35
Gender Female, 100%
Happy 99.4%
Calm 0.4%
Disgusted 0.1%
Surprised 0%
Sad 0%
Fear 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 14-22
Gender Female, 100%
Happy 98.6%
Calm 0.7%
Surprised 0.2%
Disgusted 0.1%
Sad 0.1%
Fear 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 19-27
Gender Female, 100%
Happy 97.7%
Calm 1.5%
Disgusted 0.2%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Female, 100%
Happy 99.1%
Calm 0.5%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%
Sad 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 18-26
Gender Female, 100%
Happy 98.1%
Calm 0.8%
Surprised 0.3%
Sad 0.2%
Fear 0.2%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 24-34
Gender Female, 100%
Happy 98.4%
Fear 0.3%
Sad 0.3%
Surprised 0.3%
Disgusted 0.2%
Confused 0.2%
Calm 0.2%
Angry 0.2%

AWS Rekognition

Age 20-28
Gender Female, 99.9%
Happy 98.7%
Surprised 0.3%
Confused 0.3%
Calm 0.2%
Disgusted 0.2%
Fear 0.1%
Sad 0.1%
Angry 0.1%

AWS Rekognition

Age 23-31
Gender Female, 99.9%
Happy 98.2%
Calm 0.9%
Fear 0.3%
Sad 0.2%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 22-30
Gender Female, 100%
Happy 99.1%
Surprised 0.4%
Fear 0.2%
Confused 0.1%
Disgusted 0.1%
Sad 0.1%
Angry 0.1%
Calm 0%

AWS Rekognition

Age 18-24
Gender Female, 100%
Happy 99.9%
Calm 0%
Surprised 0%
Fear 0%
Sad 0%
Confused 0%
Disgusted 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people posing for a photo 97.1%
a group of people posing for a picture 97%
a group of men posing for a photo 96.3%