Human Generated Data

Title

Untitled (six men posing by side of street with elk antlers)

Date

1949

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6982

Human Generated Data

Title

Untitled (six men posing by side of street with elk antlers)

People

Artist: Harry Annas, American 1897 - 1980

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.4
Human 99.4
Person 99.4
Person 99.1
Person 98.5
Person 98.4
Person 98.3
Person 98.2
Bicycle 92.3
Bike 92.3
Vehicle 92.3
Transportation 92.3
Person 89.3
Person 69.9
Cyclist 64.9
Sport 64.9
Sports 64.9
Nature 62.3
Outdoors 61.9
Bench 61.2
Furniture 61.2
Person 60.2
Building 58.3
Person 55.9

Imagga
created on 2022-01-23

vehicle 21.2
conveyance 20.9
wheeled vehicle 20.3
transportation 18.8
stretcher 18.4
wheelchair 18
city 16.6
chair 16.3
people 16.1
litter 15.6
building 15.6
man 14.1
industry 13.6
old 13.2
percussion instrument 13.2
urban 13.1
street 12.9
travel 12.7
male 12.1
tricycle 12
seat 11.9
road 11.7
horse 11.4
sport 11.2
adult 11
day 11
musical instrument 10.6
outdoors 10.4
architecture 10.1
equipment 9.7
window 9.7
car 9.5
furniture 9.5
outside 9.4
person 9.3
speed 9.1
drum 9.1
track 9.1
vacation 9
carriage 8.8
train 8.7
work 8.7
light 8.7
business 8.5
industrial 8.2
home 8
athlete 7.9
school 7.8
outdoor 7.6
station 7.4
room 7.3
steel drum 7.2
activity 7.2
portrait 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

building 99.4
outdoor 96.9
person 95.6
man 85.1
black and white 69.1
clothing 63.2
pulling 55
several 10.9

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 99.8%
Happy 95.1%
Calm 4.2%
Sad 0.2%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 39-47
Gender Male, 100%
Happy 97.8%
Calm 0.8%
Angry 0.5%
Fear 0.4%
Sad 0.2%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Happy 95%
Calm 4%
Angry 0.3%
Sad 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 40-48
Gender Male, 100%
Happy 97.6%
Calm 0.8%
Confused 0.3%
Disgusted 0.3%
Angry 0.3%
Fear 0.3%
Surprised 0.2%
Sad 0.2%

AWS Rekognition

Age 40-48
Gender Male, 100%
Happy 88.6%
Calm 10.8%
Sad 0.2%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 43-51
Gender Male, 96.3%
Happy 98%
Calm 1.3%
Sad 0.2%
Disgusted 0.1%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Bench 61.2%

Captions

Microsoft

a group of people riding on the back of a horse 90.4%
a group of people riding horses in front of a building 90.3%
a group of people sitting on a horse in front of a building 90.2%